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Preface 


In  October  1983  the  U.S.  Department  of  Labor  requested  that  the  National  Research 
Council  undertake  a  study  assessing  knowledge  about  youth  employment  and  training 
programs,  based  primarily  on  programs  carried  out  under  the  Youth  Employment  and 
Demonstration  Projects  Act  (YEDPA).  The  Committee  on  Youth  Employment  Programs  was 
formed  in  the  Commission  on  Behavioral  and  Social  Sciences  and  Education  to  carry  out  that 
task  and  worked  on  it  from  fall  1983  through  spring  1985.  This  report  is  the  result  of  the 
committee's  efforts. 

The  rationale  of  this  report  can  best  be  understood  in  light  of  the  charge  to  the  committee, 
the  nature  of  the  Youth  Employment  and  Demonstration  Projects  Act  activities,  and  the 
fashion  in  which  the  committee  went  about  its  work. 

The  committee's  charge  covered  four  tasks: 

•  To  review  what  is  known  about  the  effectiveness  of  the  principal  types  of  YEDPA 
programs; 

•  To  assess  existing  knowledge  regarding  the  implementation  of  youth  employment  pro¬ 
grams; 

•  To  evaluate  the  YEDPA  research  strategy; 

•  To  summarize  the  lessons  learned  from  YEDPA  for  future  policy  development  and 
program  implementation. 

The  Youth  Employment  and  Demonstration  Projects  Act  was  passed  by  Congress  and 
signed  into  law  by  President  Jimmy  Carter  in  late  1977.  The  programs  grouped  under  this  act 
ran  approximately  from  1978  through  1981,  after  which  they  were  terminated  or  reorganized 
by  the  new  administration. 

YEDPA  represented  a  substantial  and  rapid  increase  in  expenditures  by  the  federal  govern¬ 
ment  on  youth  employment  and  training  programs,  and  YEDPA  activities  encompassed 
several  different  major  types  of  programs.  The  diversity  of  programs  was  further  increased  by 
the  explicit  injunction  in  the  legislation  "to  test  the  relative  efficacy  of  different  ways  of 
dealing  with  these  [youth  employment  problems]  in  different  local  contexts"  and  the  result¬ 
ing  substantial  allocation  of  money  to  demonstration  and  research  activities  that  were  in¬ 
tended  to  demonstrate  a  wide  variety  of  program  concepts  and  attempt  to  assess  them.  It  is 
estimated  that  over  the  4-year  period  of  YEDPA  operations,  about  $600  million  was  allocated 
for  explicit  demonstration  programs  and  their  related  research  and  that,  even  in  the  first  year, 
1978,  as  many  as  60  distinct  demonstrations  were  funded  in  about  300  sites.  The  Office  of 
Youth  Programs,  which  administered  YEDPA,  stressed  the  "knowledge  development" 
aspects  of  these  demonstration  and  research  activities  and  sponsored  extensive  reporting  and 
data  gathering  concerning  them. 

It  is  not  surprising,  then,  that  our  committee  found  itself  faced  with  more  than  400  reports, 
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gathered  by  the  Employment  and  Training  Administration  of  the  Department  of  Labor, 
which  became  the  basic  raw  materials  for  our  review  of  YEDPA.  We  found  this  mass  oi 
material  both  too  much  and  too  little.  It  was  too  much  in  the  sense  of  presenting  a  serious 
challenge  to  the  committee  to  design  a  strategy  that  would  make  it  possible  to  assess  so  much 
material  thoroughly  and  in  the  time  available.  It  was  too  little  in  that  such  reports  on 
individual  programs  were  not  likely  to  provide  broad  and  comprehensive  views  of  either  the 
nature  of  youth  employment  problems  or  the  nationwide  operations  of  YEDPA.  In  this 
preface  I  attempt  to  indicate  how  we  sought  to  solve  these  problems  and,  at  the  same  time,  tc 
outline  for  the  reader  the  structure  and  rationale  of  the  report. 

As  a  first  step,  the  committee  members  and  staff  sought  to  review  and  summarize  the 
research  on  the  nature  of  the  youth  employment  problem;  some  of  the  research  had  beer 
sponsored  by  YEDPA,  but  much  of  it  was  carried  out  independently,  or  under  other  spon¬ 
sorship,  by  scholars  and  research  groups.  The  fruits  of  this  work  are  represented  in  Chapter  2 
This  task  was  made  considerably  easier  by  the  existence  of  several  excellent  overviews  o 
research  in  this  field  (which  are  referenced  in  Chapter  2).  When  entangled  in  a  review  of  the 
details  of  YEDPA  processes  and  programs,  it  is  easy  to  lose  sight  of  the  very  seriom 
employment  difficulties  faced  in  1978  by  those  youths  whom  YEDPA  was  designed  to  serve 
problems  that  youths  in  1985  appear  to  face  in  roughly  the  same  degree.  For  that  reason  th< 
committee  found  the  material  in  Chapter  2  both  a  very  important  background  and  a  reminder 
as  we  proceeded  through  the  rest  of  our  work,  not  to  lose  sight  of  the  situation  of  the 
population  at  risk.  We  hope  readers  will  find  that  material  useful  in  a  similar  fashion. 

A  second  element  in  our  strategy  was  to  seek  to  deal  with  the  more  than  400  reports.  The 
committee  developed  a  set  of  criteria — standards  of  evidence — according  to  which  the  report: 
were  to  be  vetted.  The  standards  constituted  the  minimum  required  for  a  report  to  be  judgec 
good  social  science  evidence  of  the  effects  of  a  program  on  its  participants.  The  staff,  assistec 
by  several  outside  consultants,  screened  all  the  reports  according  to  the  standards  and  thei 
classified  those  meeting  the  standards  according  to  program  type  and  target  groups  served 
(This  screening  process  is  described  in  Chapter  4.)  This  process  resulted  in  a  severe  reductioi 
in  the  number  of  projects  that  were  to  be  reviewed  in  depth:  only  28  projects  met  ou 
standards  for  in-depth  committee  review.  This  sharp  reduction  in  the  number  and  scope  o 
projects  that  met  even  our  minimal  standards  of  evidence  greatly  surprised  us,  and  it  must  b 
discouraging  for  those  who  had  hoped  for  more — in  terms  of  sheer  volume  of  results — fron 
the  YEDPA  knowledge  development  process. 

The  committee  then  turned  to  an  in-depth  review  of  those  projects.  This  was  accomplishei 
by  dividing  into  four  subcommittees,  one  for  each  of  the  four  major  categories  of  prograr 
types:  occupational  skills  training,  labor  market  preparation,  temporary  jobs,  and  job  place 
ment.  The  subcommittees  and  staff  thoroughly  reviewed  all  the  reports,  and  the  committe 
then  held  a  five-day  working  conference  to  review  and  debate  the  subcommittee  conclusion 
and  begin  drafting  what  eventually  became  Chapters  5  through  8.  Those  chapters  contain  ou 
review  of  what  is  known  and  not  known  about  the  effectiveness  of  youth  employment  an 
training  programs,  based  primarily,  though  not  exclusively,  on  the  YEDPA  experience.  Th 
draft  reports  of  the  subcommittees  were  edited,  amended,  supplemented,  and  converted  int 
the  present  report  chapters  primarily  by  staff  member  Charles  Betsey.  Important  addition; 
work  on  assessing  the  sizable  data  base  on  YEDPA  programs  created  by  the  Education; 
Testing  Service  was  undertaken  by  staff  member  Charles  Turner  and  appears  as  Appendix  P 

Chapters  5  through  8  represent  the  bulk  of  the  committee's  work,  and  we  have  chosen  t 
present  that  work  in  considerably  greater  detail  than  is  the  practice  in  more  general  review: 
We  felt  it  was  important  to  make  it  possible  for  readers  to  find  the  details  of  evidence  upo 
which  our  conclusions  and  recommendations  are  based  and  to  lay  bare  the  unevenness  i 
coverage  and  weaknesses  of  the  material  we  used,  as  well  as  the  strengths. 

We  also  faced,  as  part  of  our  charge,  the  task  of  drawing  lessons  about  the  implementatio 
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of  youth  programs  from  the  YEDPA  experience.  This  called  for  assessments  of  implementa¬ 
tion  both  at  the  national  level  of  YEDPA  design  and  at  the  local  level  of  program  realization. 
The  latter  assessment  could,  to  some  degree,  be  drawn  from  the  mass  of  400  reports  on 
YEDPA  activities.  Thus,  as  the  reports  were  screened  according  to  our  criteria  of  effective¬ 
ness,  we  also  noted  those  cases  in  which  the  reports  appeared  to  provide  useful  information 
regarding  program  implementation.  These  reports  provided  a  body  of  material  on  specific 
program  implementation,  but  we  wanted  to  supplement  this  material  to  broaden  our  view  of 
implementation. 

This  desire  led  us  to  the  third  major  element  of  our  strategy:  to  reach  outside  the  committee 
and  its  staff.  To  deal  with  the  task  of  drawing  general  conclusions  about  implementation  at 
the  local  level,  we  commissioned  three  short  papers  based  on  the  material  identified  during 
our  screening  process  and  the  authors'  own  experiences  with  youth  employment  and  training 
programs.  These  papers  by  Erik  Butler,  James  Darr,  and  Philip  Moss  provided  useful  addi¬ 
tions  to  our  own  review.  We  also  wanted  to  obtain  a  very  broad  perspective  on  the  design  and 
implementation  of  YEDPA  at  the  national  level.  To  this  end,  at  a  relatively  early  stage  in  our 
deliberations,  we  asked  Richard  Elmore  to  carry  out  a  substantial  review  of  the  development 
and  administration  of  YEDPA.  This  review  was  critical  for  the  committee  both  because  of  its 
comprehensiveness  and  quality  and  because  of  its  timeliness;  it  appears  as  the  first  of  the 
commissioned  papers  in  this  volume. 

Elmore  was  able  to  provide  the  committee  with  a  draft  of  his  review  prior  to  our  five-day 
working  conference  and  to  attend  the  conference  for  a  few  days  to  discuss  the  details  of  his 
review  with  the  committee.  Many  committee  members,  myself  included,  found  his  paper  a 
very  important  part  of  our  education  about  YEDPA;  it  brought  together  many  elements  of  the 
development  and  administration  of  YEDPA  at  the  national  level  and  presented  the  views  of 
many  of  the  key  actors  in  those  events.  This  does  not  mean  that  the  committee  endorses  all  the 
characterizations  of  events  or  conclusions  about  processes  given  in  Elmore's  paper,  but  we 
believe  it  is  a  valuable  paper  for  understanding  the  YEDPA  experience,  and  it  was  helpful  to 
us  in  drafting  Chapter  3  (as  well  as  other  sections  of  our  report) .  Chapter  3,  then,  provides  the 
details  of  our  review  of  implementation  of  YEDPA  programs,  based  on  the  program  reports 
themselves  and  the  other  materials.  The  chapter  was  largely  drafted  by  staff  member  Mary 
Papageorgiou. 

The  third  element  of  our  strategy — reaching  beyond  the  committee  for  assistance  in  filling 
gaps  in  information  and  knowledge — involved  not  only  the  papers  on  issues  of  implementa¬ 
tion  but  also  on  other  topics  for  which  the  committee  felt  its  own  expertise  was  lacking  or  for 
which  reviews  of  the  literature  proved  insufficient  to  fill  important  gaps.  It  should  be  noted 
that  all  of  the  papers  we  commissioned  were  written  under  considerable  time  pressure,  as  in 
most  cases  we  did  not  identify  the  gaps  in  knowledge  until  our  deliberations  were  well  under 
way.  In  those  cases  in  which  we  felt  the  commissioned  papers  not  only  served  the  immediate 
needs  of  the  committee  but  also  were  likely  to  be  of  general  interest  to  readers  of  this  report, 
they  are  included  in  this  volume. 

We  reached  outside  the  committee  and  staff  not  only  through  papers  but  also  through 
personal  contacts.  At  a  very  early  stage  of  our  work,  Andrew  Sum  of  Northeastern  Universi¬ 
ty,  who  has  had  a  broad  and  continuing  acquaintance  with  youth  employment  and  training 
programs,  met  with  the  committee  and  provided  an  overview  of  programs  and  youth 
employment  problems  that  helped  many  of  us  to  become  quickly  acquainted  with  develop¬ 
ments  in  this  field.  Seymour  Brandwein  of  the  Department  of  Labor,  who  was  at  the  National 
Research  Council  as  a  visiting  scholar  during  our  study,  provided  continuing  advice  and 
guidance  to  the  committee  and  staff  on  the  basis  of  his  long  and  thoughtful  experience  with 
employment  and  training  programs.  Several  committee  members  and  staff  met  with  staff 
members  of  two  other  organizations  that  had  been  involved  in  reviews  of  YEDPA  program 
effectiveness:  Andrew  Hahn  and  Robert  Lerman  of  Brandeis  University  and  Linda  Cole, 
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sioned  papers  and  personal  contacts,  we  felt  it  important  to  consider  other  sources  of  dc 
had  been,  or  could  be,  used  to  assess  the  effectiveness  of  youth  employment  and  ti 
programs.  Conspicuous  among  these  sources  were  two  national  data  bases,  the  Cont 
Longitudinal  Manpower  Survey  (CLMS)  and  the  special  youth  sample  of  the  N 
Longitudinal  Surveys  (NLS).  Our  review  and  assessment  of  studies  based  on  these  twc 
data  bases  is  provided  in  Chapter  9,  which  was  largely  drafted  by  Valerie  Nelson,  who 
as  a  consultant  throughout  the  project,  and  staff  member  Charles  Turner.  While  this  re1 
studies  from  CLMS  and  NLS  did  not  alter  in  any  respect  our  conclusions  about  the  efl 
ness  of  youth  programs,  it  did  provide  some  very  important  information  bearing  on  ap 
ate  methods  of  evaluation  of  youth  programs  that  we  believe  significantly  strengtht 
basis  for  our  recommendations  on  the  use  of  random  assignment. 

Now,  at  last,  we  come  to  the  rationale  for  the  chapter  that  we  have  placed  first,  "Sun 
Conclusions,  and  Recommendations."  This  chapter  constitutes  the  committee's  respi 
the  charge  with  which  we  began  our  work,  which  is  the  principal  reason  we  have  ele 
put  it  at  the  front  of  our  report.  Readers  will  find  in  this  chapter  the  committee's 
findings,  conclusions,  and  recommendations  about  the  nature  of  the  youth  emplc 
problem,  the  implementation  of  youth  employment  and  training  programs,  the  effect] 
of  different  types  of  programs  for  different  segments  of  the  youth  population  probl* 
strengths  and  weaknesses  of  methods  of  research  on  and  evaluation  of  youth  prograr 
the  future  evolution  of  youth  employment  and  training  programs  and  research  on  the 
are  grateful  to  staff  member  Mary  Papageorgiou  for  drafting  and  redrafting  many  vers 
this  chapter  as  the  committee  debated  the  issues. 

Chapter  1  obviously  cannot  stand  entirely  on  its  own,  but  depends  on  the  detailed  n 
that  is  provided  in  the  rest  of  the  report.  However,  as  I  noted  above,  because  the  mate] 
the  committee  was  asked  to  assess  was  so  sizable  and  complex,  we  felt  that  the  main  d 
of  the  report  had  to  have  greater  detail  than  is  usual  in  such  reports.  Since  not  all  read 
want  to  work  their  way  through  that  detail  in  order  to  reach  our  summary  stateme: 
chose  to  broaden  the  opening  chapter  of  conclusions  and  recommendations  to  pr 
reprise  of  major  themes  and  to  make  explicit  the  limitations  of  our  review  and  the  ref 
to  the  particular  programs  upon  which  each  conclusion  is  based. 

In  addition  to  the  efforts  of  the  committee  and  its  staff,  the  contributions  of  seven 
people  should  be  acknowledged.  Fred  Romero  and  William  Showier  of  the  U.S.  Depc 
of  Labor  provided  essential  support  to  the  project  and  access  to  the  materials  on  wl 
report  is  based.  David  A.  Goslin,  Executive  Director  of  the  Commission  on  Behavic 
Social  Sciences  and  Education  provided  useful  guidance  at  several  critical  junctures.  I 
Grohman,  Associate  Director  for  Reports  of  the  commission,  worked  with  the  authors 
National  Academy  Press  to  edit  and  produce  this  volume.  Jean  Shirhall  provided  ad' 
editorial  assistance,  and  Deborah  Faisson  prepared  the  manuscript  through  many  re’ 
This  report  would  not  exist  without  the  contributions  of  these  people. 

In  closing  this  preface,  I  would  like  to  emphasize  that  the  committee  and  staff  m 
have  been  motivated  throughout  our  work  by  awareness  of,  and  concern  about,  the  c 
ing  problems  of  young  people  in  our  society — particularly  those  who  have  droppe< 
school,  black  and  Hispanic  youths,  and  women,  especially  those  who  are  unmarr 
have  children — in  obtaining  and  holding  a  decent  job.  We  have  not  hesitated  to  indicai 
evidence  is  inadequate,  or  completely  lacking,  to  point  the  way  toward  more  effective 
and  programs,  and  we  have  tried  to  draw  the  lessons  from  past  experiences  that  may 
avoid  the  repetition  of  past  mistakes.  Since,  however,  the  problems  persist,  we  are  coi 
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that  the  identification  of  mistakes  of  the  past  not  become  a  basis  for  failure  to  act  in  the 
present.  We  must  continue  to  try  to  enhance  youth  employment  opportunities.  It  is  our  hope 
that  this  report  helps  to  delineate  such  a  path  for  continuing  efforts. 


Robinson  Hollister,  Jr.,  Chair 
Committee  on  Youth 
Employment  Programs 
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Summary,  Conclusions,  and 
Recommendations 


In  response  to  high  levels  of  unemployment  and  other  employment- 
related  problems  of  American  youth,  the  federal  government  enacted  the 
Youth  Employment  and  Demonstration  Projects  Act  (YEDPA;  P.L.  95-93)  in 
1977.  This  legislation  established  a  variety  of  employment,  training, 
and  demonstration  programs  for  youth.  With  the  passage  of  YEDPA, 
federal  spending  on  employment  programs  earmarked  for  youth  approxi¬ 
mately  doubled,  bringing  the  total  to  about  $2  billion  per  year. 

Besides  this  substantial  commitment  of  funds,  YEDPA  was  unique  in  its 
explicit  commitment  of  substantial  resources  to  research  and  evaluation 
efforts  intended  to  test  alternative  ways  of  meeting  the  needs  of  youth. 

YEDPA  programs  ended  in  1981  with  the  change  in  presidential 
administration.  At  that  time  the  products  of  YEDPA' s  research  had  not 
been  comprehensively  evaluated,  and  there  were  questions  about  what  had 
been  learned  from  this  undertaking.  Two  years  later  the  U.S.  Department 
of  Labor  (DOL)  requested  that  the  National  Research  Council  (NRC)  review 
the  products  of  the  YEDPA  research  effort.  The  following  eight  chapters 
detail  the  findings  from  that  review;  this  chapter  summarizes  our 
findings,  conclusions,  and  recommendations. 


THE  NATURE  OF  THE  YOUTH  EMPLOYMENT  PROBLEM 

In  focusing  on  the  nature  of  the  youth  employment  problem  at  the 
end  of  the  1970s,  as  YEDPA  began,  it  is  helpful  to  note  that  the 
majority  of  out-of-school  youths  found  jobs  and,  when  they  lost  or  left 
a  job,  found  another  one  without  a  long  period  of  unemployment.  It  has 
long  been  recognized,  however,  that  youth  employment  is  more  sensitive 
to  the  cycles  of  economic  activity  (recession  and  expansion)  than  is 
that  of  adults:  the  percentage  decline  in  employment  during  a  recession 
is  generally  greater  for  youths  than  for  adults,  but  the  percentage 
increase  in  employment  during  recovery  is  also  greater  than  for  adults. 
What  was  much  more  disturbing  was  the  worsening  long-term  trend — which 
emerged  clearly  in  the  1970s — in  the  employment  rates  of  youths  relative 
to  adults,  even  when  measured  from  the  peak  of  expansion  of  one  business 
cycle  to  the  next.  Furthermore,  the  data  reveal  substantial  differences 
in  that  trend  according  to  the  race  and  sex  of  the  youths;  the  long-term 
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population  rates  that  separate  subgroups  of  the  youth  population  by 
race,  sex,  and  school  status.  Those  data  show  that  from  1964  to  1978 
there  was  a  growing  gap  between  the  employment-to-population  ratios  of 
white  and  black  youths,  for  both  in-school  and  out-of-school  youths. 

For  in-school  youths,  employment  rates  for  whites  were  growing  while 
rates  for  black  males  were  falling  and  those  for  black  females  were  not 
growing  as  fast,  yielding  an  increasing  black-white  gap  in  employment 
rates.  While  some  may  regard  in-school  employment  opportunities  of 
lesser  importance,  researchers  have  found  that,  holding  measured  char¬ 
acteristics  constant,  those  youths  who  work  during  school  years  have 
higher  employment  rates  and  wages  after  their  school  years.  This 
finding  may  simply  reflect  that  youths  who  are  more  motivated  (an 
unmeasured  characteristic)  both  seek  work  more  energetically  while  in 
school  and  seek,  find,  and  perform  work  better  after  school,  but  the 
possibility  cannot  be  excluded  that  the  in-school  work  experience  per 
se  enhances  later  employment  and  earnings.  If  so,  the  growing  black- 
white  in-school  employment  gap  foreshadows  a  later  out-of -school 
black-white  gap  in  employment  and  earnings. 

The  black-white  employment  gap  for  out-of-school  youths  also  grew 
during  this  period  for  both  males  and  females.  And  this  occurred  while 
the  previously  existing  gap  between  blacks  and  whites  in  years  of 
schooling  attained  was  substantially  reduced.  Given  the  generally 
acknowledged  positive  relationship  between  years  of  schooling  attained 
and  employment  and  earnings,  this  reduction  should  have  narrowed  the 
employment  gap  between  blacks  and  whites;  however,  it  did  not  do  so,  or 
not  sufficiently  to  offset  other  factors  widening  the  gap.  Research 
further  shows  that  within  this  out-of-school  group,  employment  problems 
(lower  chances  of  getting  a  job,  lower  wages  when  a  job  is  obtained, 
higher  chances  of  losing  a  job,  longer  periods  of  remaining  without  a 
job  having  lost  one)  are  highly  concentrated  among  minority-group, 
inner-city,  low-income,  and  high  school  dropout  youths.  For  those  with 
combinations  of  these  characteristics  the  problems  are  compounded. 
Finally,  it  is  apparent  that  young  unwed  mothers  have  very  serious  and 
special  problems  in  qualifying  for,  finding,  and  holding  jobs,  espe¬ 
cially  at  earnings  sufficient  for  their  families'  economic  viability. 

Since  the  end  of  YEDPA  in  1981  the  United  States  has  experienced 
both  the  deepest  recession  since  the  1930s,  which  reached  its  trough  in 
1983,  and  a  sharp  economic  recovery.  There  has  also  been  a  notable 
decline  in  the  absolute  size  of  the  youth  population  since  it  reached 
its  peak  in  the  early  1980s.  It  seems  reasonable  to  ask  in  light  of 
these  events  if  the  nature  of  the  youth  employment  problem  has  sub¬ 
stantially  changed,  in  its  general  configuration,  from  what  it  was  in 
1978,  as  outlined  above,  when  YEDPA  began.  Although  exact  comparisons 
cannot  be  made  (comparable  data  are  not  yet  available)  ,  it  appears  that 
at  the  beginning  of  1985  the  employment  problems  of  youths  were  of 
about  the  same  magnitude  and  configuration  as  they  were  in  1978, 
including  racial  differentials. 


LIMITATIONS  OF  THIS  REVIEW 

Our  ability  to  respond  to  our  charge  was  necessarily  constrained  by 
the  nature  of  the  material  we  had  to  work  with.  Although  we  searched 
the  literature  available  beyond  the  reports  generated  as  part  of  the 
YEDPA  process  and  consulted  with  people  experienced  with  youth  programs 
and  related  research,  we  had  to  rely  almost  exclusively  on  the  reports 
of  particular  YEDPA  youth  demonstration  projects  to  assess  the  effec¬ 
tiveness  of  youth  programs.  The  exceptions  were  studies  of  three 
programs  that  began  before  YEDPA,  the  Job  Corps,  the  Summer  Youth 
Employment  Program,  and  Supported  Work. 

We  have  attempted  to  test  the  individual  YEDPA  research  reports 
against  reasonable  standards  of  scientific  quality  with  respect  to  both 
the  data  collected  and  the  methods  used  to  measure  program  effects. 

The  reports  that  met  such  standards  were  not  necessarily  evenly  dis¬ 
tributed  over  the  range  of  youth  programs  and  target  groups.  Thus  we 
could  not  address  certain  issues  with  respect  to  the  role  and  effec¬ 
tiveness  of  youth  employment  and  training  programs  because  of  a  lack  of 
reliable  evidence. 

Since  we  were  always  in  the  position  of  examining  these  programs 
through  the  lens  of  their  respective  research  reports,  it  is  important 
that  we  clearly  distinguish  between  the  quality  of  the  research  and  the 
(sometimes  unobservable)  quality  of  the  programs  themselves.  In  some 
instances  we  found  reliable  evidence,  both  positive  and  negative,  from 
which  to  draw  conclusions;  in  other  instances  the  available  evidence 
was  not  sufficiently  reliable  for  us  to  draw  any  conclusion,  one  way  or 
the  other.  Readers  should  be  careful  not  to  confuse  a  conclusion  about 
the  failure  of  research  to  provide  adequate  evidence  with  a  conclusion 
that  a  particular  program,  itself,  was  ineffective  or  failed  in  some 
manner.  A  conclusion  of  noneffectiveness  requires  evidence,  just  as  a 
conclusion  of  effectiveness  does.  In  the  absence  of  reliable  evidence, 
no  inference  is  possible. 

In  addition  to  the  above  limitations,  our  ability  to  draw  firm 
conclusions  was  further  constrained  by  two  conditions  that  affected  the 
implementation  of  YEDPA  and,  particularly,  the  conduct  of  the  research. 
First,  YEDPA  programs  and  research  were  mounted  in  considerable  haste 
and  in  a  period  in  which  many  other  employment  and  training  and  research 
efforts  were  going  on,  so  that  both  program  and  research  resources  were 
stretched  very  thin.  (There  are  a  few  notable  exceptions  to  this 
generalization,  e.g..  Job  Corps  and  Supported  Work.)  Second,  with  the 
change  of  administration  in  1981,  less  than  3  years  after  YEDPA' s  quick 
start-up  and  troubled  implementation,  both  programs  and  evaluation 
efforts  were  abruptly  halted. 

As  a  consequence  of  these  two  factors,  most  of  the  data  on  which 
evaluations  were  based,  again  with  a  few  notable  exceptions,  were 
gathered  at  a  stage  at  which  programs  had  not  been  stabilized.  As  a 
further  consequence,  relatively  few  program  evaluations  provide  data 
for  long  postprogram  periods:  virtually  all  of  the  YEDPA  project 
evaluations  had  only  3-  to  8-month  postprogram  follow-ups.  Only  two 
evaluations  had  as  long  as  a  3-year  follow-up  (Job  Corps  and  Supported 
Work) .  Our  review  suggests  that  longer-term  follow-ups  are  important 


in  determining  the  time  pattern  of  program  effects,  some  of  which  d< 
rapidly  and  some  of  which  emerge  slowly. 

Further  limiting  our  ability  to  draw  firm  conclusions  were  the 
serious  problems  of  researchers  in  creating  reasonable  comparison  g] 
and  preventing  sample  attrition  over  waves  of  the  data  collection. 
These  problems  sharply  reduced  the  number  of  studies  we  could  reviei 
and  put  in  question  the  reliability  of  the  results  of  several  others 

As  a  result  of  these  limitations,  our  coverage  of  YEDPA  program! 
uneven  and  not  necessarily  representative  of  overall  youth  program 
activity  during  that  period.  In  many  cases  conclusions  about  the 
effects  of  specific  types  of  programs  are  based  on  only  one  or  two 
evaluations,  in  other  cases  there  is  no  reliable  evidence  for  any  c< 
elusion  of  program  effect.  In  addition,  the  quality  of  evidence  vai 
sometimes  supporting  strong  conclusions,  sometimes  merely  suggesting 
the  direction  of  program  effects.  In  presenting  our  conclusions, 
therefore,  we  try  to  indicate  the  source  of  the  evidence  and  the  de< 
of  its  reliability,  and  we  distinguish  lack  of  reliable  evidence  fre 
lack  of  evidence  per  se. 

A  final  limitation  of  this  review  concerns  the  very  magnitude  oJ 
YEDPA  and  Comprehensive  Employment  and  Training  Act  (CETA)  programs 
from  1977  through  1981.  It  has  been  estimated  that  in  1979  as  much 
two-fifths  of  all  jobs  held  by  black  teenagers  were  in  government 
employment  and  training  programs.  Thus,  even  when  comparison  groups 
were  reasonably  created,  there  may  well  have  been  substantial  amount 
of  employment,  training,  and  related  effects  from  federal  programs 
among  the  comparison  group  members.  To  the  degree  this  problem  is 
serious  and  undetected  in  the  evaluation  data,  the  participant- 
comparison  contrasts  will  underestimate  the  impact  of  the  programs. 


FINDINGS  AND  CONCLUSIONS  ON  PROGRAM  IMPLEMENTATION 

The  conditions  under  which  YEDPA  was  implemented  severely  con¬ 
strained  both  the  potential  effectiveness  of  the  programs  themselves 
reaching  their  objectives  and  the  related  research  and  demonstratior 
activities  that  sought  to  evaluate  program  effects  and  to  create  a 
reliable  knowledge  base  for  future  youth  programs.  Implementation  w 
affected  by:  (1)  the  size  and  implicit  duality  of  the  YEDPA  service 
research  mandate;  (2)  the  congressional  and  executive  time  schedules 
imposed  on  YEDPA  program  operations  and  research  results;  and  (3)  tt 
instability  of  the  service  delivery  system  due  to  fluctuations  in 
employment  and  training  policy,  regulations,  and  funding  levels.  Tt 
combination  of  these  three  factors  was  significant  in  determining  th 
course  of  YEDPA  at  both  the  national  and  local  levels. 

The  duality  of  the  YEDPA  mandate,  which  was  inherent  in  the 
enabling  legislation,  stemmed  from  the  charge  to  mount  new  and  very 
large  service  delivery  programs  quickly  and  at  the  same  time  to  desi 
and  conduct  comprehensive  research  and  evaluation.  Either  of  these 
tasks  by  itself  would  have  been  a  sizable  and  complex  endeavor;  take 
together  they  burdened  the  system  not  only  by  their  sheer  magnitude, 


Dut  by  their  diversity  of  purpose,  at  times  pitting  the  interests  of 
program  delivery  against  those  of  research  and  knowledge  development. 

The  imposition  of  two  consecutive  time  limits  also  constrained  the 
mplementation  of  YEDPA  programs  and  research.  The  first,  imposed  by 
the  legislation  itself,  required  that  YEDPA  be  sufficiently  operational 
within  1  year  of  passage  to  warrant  congressional  reauthorization;  and 
the  second,  imposed  by  the  executive  office,  required  that  within  2 
years  the  results  of  YEDPA  program  research  be  adequate  to  inform  the 
Vice  President's  Task  Force  on  Youth  Employment  for  its  subsequent 
report  to  Congress.  These  limits  put  tremendous  pressure  on  the 
national  office  of  the  Department  of  Labor  to  get  both  the  programs  and 
the  research  under  way  immediately  and  foreshortened  the  time  available 
for  careful  planning  of  either  the  programs  or  the  research  on  their 
effects. 

The  third  major  factor  constraining  YEDPA  was  one  that  overrides 
YEDPA  itself,  and  of  which,  in  fact,  YEDPA  is  a  prime  example:  the 
tremendous  fluctuations  from  one  administration  to  the  next,  and  often 
from  one  fiscal  year  to  the  next,  in  employment  and  training  policy, 
regulations,  and  most  importantly,  funding  levels.  This  instability, 
erhaps  more  than  any  other  factor ,  undermined  the  employment  and 
training  system,  particularly  at  the  local  level,  where  in  response  to 
such  changes  adjustments  in  all  aspects  of  program  operations  ultimately 
have  to  be  made.  Such  fluctuations  precluded  a  more  stable  and  orderly 
evelopment  and  institutionalization  of  the  youth  employment  system. 
Given  the  instability  of  the  employment  and  training  system,  together 
ith  the  implementation  requirements  of  YEDPA,  it  was  somewhat  unreal¬ 
istic  to  expect  that  within  3  years  these  programs  would  be  fully 
perational  and  ready  to  prove  their  effectiveness. 

CONCLUSION:  The  YEDPA  legislation  created  a  program  that 
combined  too  short  a  time  schedule  with  too  many  different 
program  elements  and  objectives.  The  demand  to  quickly 
implement  the  full  range  of  elements  impaired  the  quality  of 
many  of  the  programs.  In  addition,  the  pressure  to  obtain  a 
wide  range  of  research  results  on  those  programs  within  a  short 
time  compounded  the  problem  and  resulted,  in  many  cases,  in 
poor  research  on  hastily  constructed  programs.  It  may  be  that 
the  lack  of  proven  effectiveness  of  many  programs  is  due  as 
much  to  the  instability  of  the  system  as  to  the  inherent  nature 
of  the  programs. 


National  Office  Management  of  YEDPA 

The  tasks  of  designing  and  implementing  YEDPA  programs  and  research 
activities  strained  the  capacity  of  DOL's  Office  of  Youth  Programs 
(OYP)  given  its  very  small  staff  and  limited  research  capability.  In 
response  to  these  demands  OYP  created  a  system  of  indirect  management, 
delegating  substantial  responsibility  for  the  design,  implementation, 
management,  and  evaluation  of  major  YEDPA  demonstration  programs  to 
private  nonprofit  intermediary  organizations.  In  addition  OYP  extended 


the  staff’s  research  capability  through  agreements  with  other  research 
units  within  the  Department  of  Labor/  with  the  Educational  Testing 
Service  (ETS) ,  and  with  Brandeis  University's  Center  for  Employment  and 
Income  Studies  (CEIS) .  Agreements  with  other  federal  agencies  to 
operate  other  portions  of  YEDPA  were  another  means  of  expanding  the 
YEDPA  management  structure. 

As  a  means  of  quickly  disbursing  funds  and  implementing  programs 
under  severe  time  constraints,  the  agreements  with  other  parties  were 
expedient.  As  a  means  of  managing  programs  and  research,  however,  that 
approach  was  not  very  effective.  Of  the  four  intermediary  organiza¬ 
tions,  only  two,  the  Manpower  Demonstration  Research  Corporation  (MDRC) 
and  the  Corporation  for  Public/Private  Ventures  (CPPV)  ,  produced 
competent  research  on  program  impacts  on  participants.  The  results  of 
programs  operated  by  the  other  two  intermediaries,  the  Corporation  for 
Youth  Enterprises  (CYE)  and  Youthwork,  organizations  created  to  manage 
YEDPA  demonstrations,  are  largely  unknown  because  those  organizations, 
although  they  did  produce  reports,  did  not  attempt  to  assess  program 
impact  in  a  quantitative  manner  that  could  be  evaluated.  The  results 
of  programs  operated  under  interagency  agreements  are  also  unknown 
either  because  no  program  research  was  conducted  or  because  research 
reports  failed  to  meet  our  criteria  of  scientific  evidence.  In 
general,  considering  the  amount  of  YEDPA  funds  channeled  through 
intermediaries  and  interagency  agreements,  remarkably  little  is  known 
about  the  programs  or  their  results. 

The  results  of  OYP's  other  agreements  were  also  mixed.  Agreements 
with  other  ETA  research  units  to  incorporate  a  youth  sample  in  the 
National  Longitudinal  Survey  (NLS)  and  YEDPA  samples  in  the  Continuous 
Longitudinal  Manpower  Survey  (CLMS)  data  bases  produced  useful  results. 
The  agreement  with  the  Educational  Testing  Service  to  establish  a  large 
national  data  base  on  YEDPA  programs  and  participants,  however,  was 
poorly  planned  and  implemented.  The  support  provided  by  the  Center  for 
Employment  and  Income  Studies  was  effective  in  documenting  and  assessing 
YEDPA  programs,  but  CEIS's  technical  assistance  and  oversight  of  YEDPA 
research  were  not — and  given  the  scale  of  the  task,  could  not  have 
been — sufficient  to  ensure  the  comprehensiveness  of  its  research  design 
or  the  quality  of  its  execution,  at  least  as  evidenced  by  our  review. 

CONCLUSION:  The  resources  provided  to  the  Office  of  Youth 
Programs  were  woefully  insufficient  to  its  charge  to  mount  and 
manage  YEDPA  programs  and  research.  Lacking  research  staff  and 
resources,  OYP  delegated  responsibility  for  the  design  and 
evaluation  of  large  portions  of  the  YEDPA  demonstration  research 
agenda  to  parties  outside  the  Department  of  Labor.  The 
resulting  management  structure  lacked  sufficient  control  at  the 
center  to  provide  coherence  in  program  objectives  and  policies, 
to  monitor  developments,  and  to  ensure  accountability. 

These  conditions  had  their  greatest  impact  at  the  local  level. 

With  its  additional  reporting  requirements,  increased  federal  control 
over  program  design  and  target  groups,  increased  services  to  youths, 
and  the  demands  of  research  and  demonstration,  YEDPA  imposed  substan- 


ial  administrative  burdens  on  local  prime  sponsors.  The  competing 
demands  of  a  substantially  increased  Public  Service  Employment  Program 
and  the  regular  programs  under  the  Comprehensive  Employment  and 
Training  Act  (CETA)  placed  YEDPA  in  a  strained  local  environment. 

The  demands  of  the  YEDPA  agenda  and  the  time  schedule  for  their 
implementation  severely  hampered  local  program  planning  and  assembly. 
The  increased  federal  program  requirements  compressed  the  already 
shortened  planning  and  approval  process,  which  was  complicated  by  the 
lack  of  clear  guidance  from  the  national  office.  To  the  extent  that 
these  conditions  interfered  with  the  careful  planning  of  services, 
selection  of  program  operators,  coordination  with  other  parties  in  the 
local  service  delivery  network,  identification  and  recruitment  of 
participants,  and  assessment  of  local  need  for  these  programs,  there 
were  consequences  for  each  subsequent  stage  of  program  operations  and, 
ultimately,  for  the  success  of  the  programs. 

Despite  these  problems,  YEDPA  did  succeed  in  mounting  new  programs, 
at  double  the  size  of  previous  youth  programs,  and  in  providing  large 
numbers  of  disadvantaged  youths  with  jobs.  Furthermore,  the  evidence 
indicates  that  those  jobs  were  generally  well  supervised  and  worthwhile 
experiences  for  both  the  participants  and  their  employers. 


Targeting,  Recruiting,  and  Retaining  Youths 

Research  on  YEDPA  programs  cites  numerous  problems  with  targeting 
and  recruiting  sufficient  numbers  of  eligible  youths  from  the  designated 
target  groups:  in-school  and  out-of-school  youths  meeting  criteria  of 
economic  disadvantage.  This  problem  was  attributed  in  part  to  the 
short  planning  time  and  the  resulting  tendency  of  prime  sponsors  to 
base  needs  assessments  on  outdated  information  and  to  overestimate 
target  group  size.  In  addition,  a  legislative  requirement  that  youths 
in  regular  CETA  programs  be  served  at  the  same  levels  as  previously  and 
the  strict  eligibility  requirements  for  some  YEDPA  programs  may  have 
resulted  in  a  shortage  of  eligible  youths  in  some  local  areas. 

A  related  problem  cited  in  many  reports  was  the  tendency  of  program 
operators  to  serve  the  least  disadvantaged  of  the  eligible  youths, 
leaving  the  most  disadvantaged  and  needy  without  services.  This 
phenomenon,  known  as  "creaming,"  reflects  the  tradeoff  that  many 
program  operators  perceived  between  serving  those  most  in  need  versus 
those  more  likely  to  succeed.  It  raises  both  equity  and  efficiency 
issues  to  the  extent  that  the  less  disadvantaged  might  have  achieved 
the  same  employment  results  without  benefit  of  the  programs. 

An  example  of  this  tradeoff,  and  one  representing  a  major  dilemma 
for  YEDPA,  was  the  targeting  of  services  for  dropout  versus  in-school 
youths.  An  inherent  tendency  of  many  YEDPA  programs  was  to  gravitate 
to  the  in-school  population.  A  22  percent  YEDPA  set-aside  for  linkages 
with  the  schools  was  an  additional  incentive  for  local  prime  sponsors 
to  target  in-school  youths.  The  dilemma  was  that  the  group  most  in 
need  of  employment  services — the  dropout  population — was  also  the  group 
that  was  hardest  to  recruit  and  to  serve  successfully.  Conversely,  the 
group  most  easily  recruited  and  served — the  in-school  population — was 
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the  group  for  which  services  were  less  critical  (or  at  least  for  whoi 
the  problem  was  less  clearly  defined) . 

Though  it  is  widely  recognized  that  of  all  youth  employment  prob‘ 
those  of  school  dropouts  are  the  most  serious,  there  appears  to  be  a 
tendency  for  employment  and  training  programs  to  avoid  serving  this 
group.  Many  programs  designed  specifically  to  serve  dropouts  (eithe: 
through  school-conditioned  work  or  through  alternative  education, 
training,  or  work  settings)  often  had  difficulties  recruiting  them  ai 
once  they  were  recruited,  experienced  difficulties  retaining  them  in 
the  programs.  Other  projects  designed  to  serve  either  in-school  or 
out-of -school  youths,  facing  similar  difficulties,  evolved  toward 
serving  in-school  youths,  recasting  the  dropout  problem  in  terms  of 
prevention  instead  of  remediation. 

CONCLUSION:  In  meeting  the  increased  enrollment  and  rapid 
implementation  requirements  of  YEDPA ,  prime  sponsors  when  given 
the  option  of  serving  either  in-school  or  out-of-school  youths 
tended  to  focus  resources  on  the  in-school  population.  Even 
when  programs  were  specifically  targeted  to  dropouts,  they 
often  had  difficulty  in  recruiting  and  retaining  them.  As  a 
result,  the  question  of  how  to  reach  and  serve  dropout  youths 
effectively  was  largely  unanswered  by  YEDPA. 


Enrollment  of  Young  Women 

Most  of  the  youth  programs  we  reviewed  enrolled  substantial  numb' 
of  young  women,  and  evidence  from  some  programs  suggests  more  posits 
effects  for  young  women  than  for  young  men.  Many  of  the  programs,  hi 
ever,  encountered  difficulties  maintaining  enrollment  of  economicall; 
disadvantaged  young  women,  apparently  because  of  the  high  incidence  < 
teenage  pregnancy  and  childbearing.  Most  program  operators  and 
evaluators  apparently  overlooked  this  characteristic  of  the  target 
population,  and  so  there  is  little  direct  evidence  on  the  effect  of 
pregnancy  and  childbearing  on  program  participation  or  on  the  effect 
program  participation  on  subsequent  pregnancy  and  childbearing. 

Evidence  from  one  demonstration  program  designed  to  serve  pregna 
and  parenting  teenagers  under  the  age  of  18  (Project  Redirection)  is 
equivocal  on  the  effect  of  a  service-coordination  strategy  in  reduci 
pregnancy  and  increasing  subsequent  employment  and  earnings.  Neithe 
is  there  evidence  to  date  that  would  allow  clear  distinctions  to  be 
made  as  to  the  effects  of  alternative  decisions  about  pregnancy  reso! 
tion,  i.e.,  birth,  adoption,  or  abortion,  on  other  program  outcomes. 

CONCLUSION:  Most  youth  programs  had  substantial  enrollments  of 
young  women.  Many,  especially  those  serving  older  teenagers, 
encountered  difficulties  maintaining  enrollment  of  economically 
disadvantaged  young  women  because  of  the  high  incidence  of 
childbearing . 


FINDINGS  AND  CONCLUSIONS  ON  PROGRAM  EFFECTIVENESS 


Our  conclusions  are  based  on  a  review  of  28  programs,  including 
oth  demonstration  projects  and  regular  youth  programs.  In  this  review 
re  proceed  by  type  of  program  and  within  type  of  program  by  target 
roup,  out-of -school  youths  (both  dropouts  and  graduates)  or  in-school 
ouths. 


Occupational  Skills  Training  Programs 

Our  conclusions  on  skills  training  are  based  on  evaluations  of  only 
;wo  programs,  the  residential  Job  Corps  program  for  out-of-school, 
lainly  dropout,  youths  and  an  apprenticeship  program  for  in-school 
r ouths . 


)ccupational  Skills  Training  Programs  for  Out-of-School  Youths: 

?he  Job  Corps 

The  Job  Corps  stands  out  in  our  review  as  a  program  for  which  there 
.s  strong  evidence  regarding  program  effectiveness.  The  quality  of  the 
evaluation  reviewed,  in  terms  of  sample  sizes,  comparison  group  method- 
>logy,  sample  attrition,  and  the  measurement  of  outcome  variables, 

Lends  confidence  to  these  conclusions. 

The  Job  Corps  is  a  comprehensive  program  providing  occupational 
skills  training,  basic  (and  remedial)  education,  counseling,  health 
:are,  and  job  placement  to  youths  more  disadvantaged  than  typical 
participants  in  youth  programs.  Although  the  contribution  of  each 
component  part  of  the  program  is  not  known,  it  is  clear  that  as  a  whole 
the  program  has  provided  positive  benefits  to  participants  in  terms  of 
employment,  earnings,  and  education. 

On  average,  for  up  to  3-1/2  years  after  participation.  Job  Corps 
enrollees  earned  28  percent  more  per  year  ($567  in  1977  dollars)  and 
worked  3  weeks  more  per  year  than  nonparticipant  comparisons.  In 
addition,  participation  reduced  receipt  of  welfare  and  unemployment  by 
2  weeks  and  1  week  per  year,  respectively. 

CONCLUSION:  Job  Corps  participation  resulted  in  gains  in 
employment  and  earnings  in  the  postprogram  period  and  in 
declines  in  receipt  of  welfare  and  unemployment  payments . 

These  positive  effects  persisted  at  a  relatively  stable  rate 
for  up  to  4  years  after  youths  left  the  program. 

Participation  in  the  Jobs  Corps  increased  the  probability  that  Job 
Corps  enrollees  would  receive  a  high  school  diploma  or  a  General 
Equivalency  Diploma  (GED) .  Specifically,  the  probability  was  .24  for 
participants  compared  with  .05  for  comparisons. 

CONCLUSION:  Job  Corps  participation  resulted  in  gains  in 
educational  attainment  during  the  program  as  measured  by 
completion  of  GEDs. 


The  Job  corps  evaluation  measured  criminal  activity  ana  round 
Job  Corps  participation  significantly  reduced  the  criminal  activi 
participants . 

CONCLUSION:  Jobs  Corps  participation  resulted  in  decreases  i 
criminal  activity,  as  indicated  by  rates  of  arrest  during 
program  participation  and  decreases  in  seriousness  of  crimes 
the  postprogram  period. 

In  addition,  although  the  Job  Corps  by  far  exceeded  the  per- 
participant  costs  of  other  youth  programs,  the  benefit-cost  analy 
indicated  a  net  benefit. 

CONCLUSION;  The  benefits  of  Job  Corps  participation  in  terms 
of  increased  employment  and  earnings  and  decreased  crime  and 
transfer  payments  exceeded  the  costs  by  a  sizable  margin 
($2,300)  per  enrollee. 


Other  Occupational  Skills  Training  Programs 

Although  there  is  substantial  evidence  on  the  effectiveness  c 
Job  Corps,  it  is  not  known  which  of  its  several  component  parts  c 
tribute  to  which  effects;  how  much  (if  any)  is  due  to  the  self-se 
factors  of  youths  who  enroll  in  the  program;  or  how  program  compo 
and  participant  characteristics  interact.  The  residential  requir 
of  the  Job  Corps,  in  particular,  is  untested  as  a  factor  in  expla 
the  program's  effectiveness  and  precludes  generalizing  its  result 
nonresidential  settings.  Nonresidential  skills  training  would  ce 
be  less  expensive  to  operate  than  the  Job  Corps;  however,  YEDPA 
produced  no  reliable  evidence  on  the  effectiveness  of  occupationa 
skills  training  provided  in  a  nonresidential  setting  for  out-of-s 
youths  generally  or  for  the  severely  disadvantaged  population  of 
out-of-school  youths  served  by  the  Job  Corps. 


Occupational  Skills  Training  Programs  for  In-School  Youths 

The  committee  found  few  studies  of  occupational  skills  traini 
programs  operated  under  YEDPA.  This  was  due,  at  least  in  part,  t 
concern  that  participants  require  a  sufficiently  high  level  of  ac 
preparation  to  be  able  to  gain  from  such  training. 

We  reviewed  only  one  program  providing  occupational  skills  ti 
to  in-school  youths.  This  program  (New  Youth  Initiatives  in  Appr 
ship)  was  designed  to  prepare  high  school  seniors  for  registered 
apprenticeships  after  graduation. 

CONCLUSION:  There  is  only  very  limited  evidence  from  YEDPA  c 
the  effectiveness  of  skills  training  for  in-school  youths.  *] 
only  program  that  provided  evidence  of  reasonable  quality 
showed  no  effect  on  participants'  postprogram  earnings  or 


employment  rates.  However,  this  program  was  so  special  in 
nature  and  participant  characteristics  that  one  would  not  wish 
to  base  general  conclusions  about  skills  training  for  in-school 
youths  on  the  evidence  from  this  program  alone. 


Labor  Market  Preparation  Programs 

The  programs  classified  as  labor  market  preparation  programs  in  our 
review  were  very  heterogeneous  in  terms  of  their  services  and 
activities,  but  they  shared  the  long-term  goal  of  preparing  youths  for 
their  future  work  lives  by  improving  their  personal  skills,  knowledge, 
and  attitudes  toward  the  work  place.  Activities  ranged  from  career 
exploration  and  job  search  assistance  to  remedial  education  and 
combinations  of  work  experience  and  classroom  training.  The  programs 
also  varied  greatly  in  intensity  and  duration,  ranging  from  5  to  35 
hours  per  week  and  from  10  weeks  to  1  year. 


Programs  for  Out-of -School  Youths 

Studies  of  labor  market  preparation  programs  serving  out-of-school 
youths  tended  to  provide  sounder  evidence  on  program  effectiveness  than 
did  studies  of  programs  serving  in-school  youths,  in  the  3-  to  8-month 
postprogram  period,  participants  often  exhibited  significantly  better 
employment  outcomes  than  nonparticipants.  It  is  particularly  trouble¬ 
some,  however,  that  the  term  "out-of -school  youths"  is  used  to  refer  to 
high  school  graduates  as  well  as  dropouts:  the  programs  providing 
reliable  evidence  served  varying  mixtures  of  the  two  groups  and  did  not 
produce  separate  analyses  of  effects.  This  lack  of  separate  analysis 
for  dropouts  and  graduates  conditions  our  confidence  in  the  evidence 
because  program  outcomes  (e.g.,  employment  and  earnings,  and  educational 
attainment)  might  be  influenced  by  whether  the  youths  had  completed 
high  school. 

CONCLUSION:  YEDPA  programs  providing  labor  market  preparation 
for  out-of-school  youths  resulted  in  some  positive  effects  on 
employment  in  the  3  to  8  months  following  program  participation 
(Alternative  Youth  Employment  Strategies,  the  Recruitment  and 
Training  Program,  Project  STEADY) ,  There  are  no  reliable  data, 
however,  to  determine  whether  these  short-term  gains  are 
sustained  over  the  long  run  or  whether  such  programs  had  any 
effects  on  educational  attainment  or  other  goals,  such  as 
reduced  crime  and  substance  abuse. 


Programs  for  In-School  Youths 

Some  of  the  reports  on  in-school  programs  we  reviewed  indicated 
that  program  operators  did  not  expect  to  directly  affect  the  youths' 
postprogram  earnings  or  employment;  instead,  they  concentrated  on  other 


program  goals,  such  as  improving  reading,  mathematics  skills,  work 
attitudes,  and  other  skills  measured  by  the  Standardized  Assessment 
System,  a  battery  of  tests  developed  by  the  Educational  Testing 
Service.  Although  numerous  programs  under  YEDPA  provided  labor  marke 
preparation  services  to  in-school  youths,  the  research  on  the  effects 
of  these  programs  was  of  low  quality.  Even  for  the  few  research 
reports  of  sufficient  quality  to  be  reviewed  in  depth  (Opportunities 
Industrialization  Centers  of  America,  National  Puerto  Rican  Forum 
(NPRF) ,  Project  Redirection)  each  was  so  seriously  flawed  in  one 
respect  or  another  that  we  could  draw  no  conclusions  regarding  the 
effects  of  such  in-school  labor  market  preparation  programs  on 
employment,  earnings,  educational  attainment,  or  other  goals. 


Temporary  Jobs  Programs 

Programs  providing  temporary  subsidized  employment  have  until 
recently,  with  the  passage  of  the  Job  Training  Partnership  Act  (JTPA) 
been  a  major  focus  of  employment  and  training  policy  for  youths.  The 
objectives  of  these  programs  were  to  solve  the  immediate  employment 
(and  income)  needs  of  disadvantaged  youths  and  to  provide  them  with 
work  experience  which  would  be  a  basis  of  future  employment.  .  In 
addition,  under  YEDPA  a  major  thrust  was  the  testing  of  an  entitlemer 
to  subsidized  jobs  for  economically  disadvantaged  youths  (Youth 
Incentive  Entitlement  Pilot  Projects) ,  which  was  designed  to  encourac 
them  to  remain  in  or  return  to  school. 


Programs  for  Out-of-School  Youths 

Two  subsidized  jobs  programs  operated  under  YEDPA,  Ventures  in 
Community  Improvement  (VICI)  and  Supported  Work,  showed  that  partici¬ 
pants  experienced  increased  employment  and  earnings  during  the  progrc 
compared  with  a  similar  group  of  nonparticipants. 

CONCLUSION:  Temporary  jobs  programs  for  out-of-school  youths 
that  were  operated  during  the  YEDPA  period  were  effective  in 
increasing  participants'  employment  and  earnings  during  the 
period  of  program  participation. 

The  types  of  subsidized  job  opportunities  provided  in  YEDPA 
demonstration  programs  varied  widely.  Most,  as  required  under  CETA, 
were  in  the  public  sector.  YEDPA,  however,  for  the  first  time  allowe 
work  experience  placements  in  private  for-profit  businesses.  Evident 
from  the  Public  Versus  Private  Sector  Jobs  Demonstration  Project 
tentatively  indicates  that  while  it  was  possible  to  create  subsidizet 
employment  in  the  private  sector,  substantially  more  effort  was 
required  to  do  so.  This  finding  is  not  surprising  considering  the  1« 
of  experience  of  prime  sponsors  in  developing  private  sector  jobs  an< 
the  lack  of  experience  of  the  employers  in  working  with  government- 
sponsored  programs.  Evaluations  of  Supported  Work  and  VICI  programs 


output  that  was  of  value  to  the  employing  agency  and  to  society  in 
general. 

CONCLUSION;  Subsidized  jobs  programs  for  out-of-school  youths 
can  be  effectively  operated  in  the  public  and  private  sectors , 
though  substantially  more  effort  is  required  to  enlist  private 
sector  employers.  Such  jobs  need  not  be  "make-work1*  but  can 
provide  output  of  positive  social  and  economic  value. 

Probably  the  most  important  goal  of  temporary  jobs  programs  for 
out-of-school  youths  is  to  provide  an  experience  that  will  raise  the 
postprogram  employment  and  earnings  of  participants  over  what  they 
would  have  been  without  that  experience.  Unfortunately,  the  only 
evidence  on  this  issue  that  we  found  reliable  was  that  for  Supported 
Work.  The  Supported  Work  program  served  a  severely  disadvantaged 
segment  of  dropout  youths  and,  therefore,  the  degree  to  which  its 
findings  can  be  generalized  to  the  wider  out-of-school  youth  population 
is  not  known.  However,  the  long  postprogram  follow-up  study  (15  to  67 
months)  provided  strong  evidence  of  no  long-term  gains  in  postprogram 
employment  and  earnings. 

CONCLUSION:  The  evaluation  of  the  Supported  Work  program  for 

severely  disadvantaged  school  dropouts  provided  strong  evidence 
of  no  long-term  gains  in  employment  and  earnings. 

In  addition  to  their  value  as  a  source  of  immediate  employment  and 
as  a  bridge  to  longer-term  unsubsidized  employment,  temporary  jobs 
programs  have  sometimes  been  seen  as  yielding  social  value  in  the  form 
of  return  to  school  by  dropouts  or  entrance  in  alternative  education 
(GED)  programs  or  through  deterrence  of  crime  and  substance  (drug  and 
alcohol)  abuse.  The  only  temporary  jobs  program  for  out-of-school 
youths  reviewed  here  for  which  evidence  on  these  measures  was  found 
reliable  (Supported  Work)  seemed  to  have  no  such  effects. 

CONCLUSION:  A  temporary  jobs  program  for  severely 
disadvantaged  out-of-school  youths  (Supported  Work)  had  no 
effect  on  educational  attainment  nor  on  reducing  crime  or 
alcohol  and  drug  abuse. 

The  entitlement  program,  which  guaranteed  jobs  for  dropouts  if  they 
returned  to  school,  provides  evidence  on  the  effects  of  temporary  jobs 
programs  on  school  completion.  Its  effectiveness  is  discussed  in  the 
next  section. 


Programs  for  In-School  Youths 

Temporary  jobs  programs  for  in-school  youths  under  YEDPA  were 
provided  to  meet  the  immediate  part-time  employment  needs  of  school 
youths  both  during  the  school  year  and  in  the  summer.  Like  temporary 
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Unfortunately,  none  of  the  research  on  the  YEDPA  temporary  jobs 
programs  for  in-school  youths  produced  reliable  long-term  follow-up 
lata  that  would  permit  determination  of  the  long-term  effects  on 
mployment  and  earnings. 

CONCLUSION:  YEDPA  produced  no  reliable  evidence  on  the  effect 
of  temporary  jobs  programs  on  the  long-run  postprogram 
employment  and  earnings  of  in-school  youths. 

One  of  the  purposes  of  temporary  jobs  programs  for  in-school  youths 
was  to  prevent  youths  from  dropping  out  of  school  in  order  to  find 
employment.  The  entitlement  project  in  fact  set  school  enrollment  as 
n  eligibility  requirement  for  a  subsidized  job  and  had  as  a  major 
objective  the  retention  of  youths  in  school.  Comparison  of  school 
retention  rates  in  entitlement  and  nonparticipant  sites,  however, 
indicates  that  the  program  had  no  effect  on  school  retention.  The 
Summer  Youth  Employment  Program  also  emphasized  return  to  school  as  an 
objective  but  there  are  no  reliable  data  on  the  effect  of  SYEP  on 
school  return  or  retention. 

CONCLUSION:  A  major  program  (entitlement)  offering  temporary 
jobs  to  youths  on  the  condition  that  they  remain  in  school  was 
not  effective  in  increasing  school  retention. 

An  express  aim  of  the  entitlement  program  was  not  only  to  prevent 
dropouts  but  also  to  encourage  those  who  had  already  dropped  out  to 
return  to  school  by  offering  them  a  subsidized  part-time  job  during  the 
school  year  and  a  full-time  job  during  the  summer,  both  conditional  on 
ontinued  enrollment  in  school.  This  incentive,  though  it  did  encourage 
some  dropouts  to  return  to  school  initially,  was  ineffective  in  retain¬ 
ing  them — comparison  of  entitlement  and  nonparticipant  sites  indicates 
no  differences  in  school  completion  rates. 

CONCLUSION;  A  major  program  (entitlement)  offering  temporary 
jobs  to  school  dropouts  on  the  condition  that  they  return  to 
school  did  not  increase  school  completion  among  these  youths. 


Job  Placement  Programs 

Job  placement  programs,  which  provided  job  search  assistance, 
career  information,  and  job  placement  to  youths,  were  designed  to  ease 
the  labor  market  exchange  between  potential  employees  and  employers. 
Such  programs  were  thought  to  increase  employment  and  earnings  of 
youths  through  more  efficient  operation  of  the  labor  market.  Although 
job  placement  was  often  a  component  of  other  more  comprehensive 
programs,  the  programs  considered  here  offered  only  job  placement.  The 
conclusions  drawn,  therefore,  do  not  necessarily  apply  to  job  placement 
as  a  support  service  in  other  programs. 

Conclusions  on  the  effectiveness  of  job  placement  programs  for 
out-of-school  youths  are  based  on  evaluation  of  two  projects,  70001  and 


the  Job  Factory.  Conclusions  on  programs  for  in-school  youths  are 
based  on  evaluations  of  Jobs  for  America's  Graduates  (JAG)  and  Jobs  f< 
Delaware  Graduates  (JDG) . 

Both  the  clientele  and  the  costs  of  the  programs  we  reviewed  vari< 
widely.  Jobs  for  Delaware  Graduates  served  largely  nondisadvantaged , 
noncollege  bound  in-school  youths  and  offered  no  stipends  for  partici¬ 
pation.  The  70001  program,  funded  with  YEDPA  money,  served 
disadvantaged  youths,  both  in-school  and  out-of-school,  and  provided 
stipends. 

In  general,  the  effect  of  these  job  placement  programs  for  both 
in-school  and  out-of-school  youths  was  to  produce  short-term  increases 
in  the  rates  of  employment  and  earnings  of  participants  over  those  of 
similar  youths  not  receiving  such  services.  There  is  evidence  that 
these  effects  lasted  for  the  first  year  after  program  participation, 
decayed,  and  then  disappeared  by  the  end  of  the  second  year. 

CONCLUSION;  Programs  designed  to  provide  job  placement 
assistance  to  in-school  and  out-of-school  youths  were  effective 
in  increasing  employment  for  the  first  year  after  program 
participation.  This  effect  decayed  gradually  and  disappeared 
entirely  by  2  years  after  program  completion. 


Benefit-Cost  Estimates 

After  a  review  of  the  effects  of  YEDPA  programs,  it  is  natural  to 
ask  about  the  efficiency  with  which  the  programs  achieved  those 
effects.  The  most  rigorous  way  to  formulate  a  response  to  this 
question  is  in  terms  of  a  comprehensive  benefit-cost  analysis. 

In  order  to  make  a  complete  benefit-cost  analysis  of  a  program  it 
is  necessary,  first,  to  have  reliable  estimates  of  the  effects  of  the 
program  and,  second,  to  have  an  appropriate  accounting  framework  that 
translates  those  estimates  of  effects  into  benefits  and  costs.  Many  o 
the  programs  we  reviewed  lacked  the  first  element  and,  except  for  Job 
Corps  and  Supported  Work  (programs  that  predated  YEDPA)  ,  even  when 
reliable  estimates  of  effects  were  available,  they  were  not  translated 
into  benefit  and  cost  estimates.  For  Job  Corps  and  Supported  Work,  we 
found  the  benefit-cost  analyses  reliable  and  comprehensive:  for  Job 
Corps,  the  social  benefits  were  found  to  exceed  social  costs;  for 
Supported  Work,  the  social  costs  were  found  to  exceed  social  benefits. 
With  the  exception  of  two  programs  (Job  Corps  and  Supported  Work)  ,  we 
could  not  find  sufficient  reliable  evidence  to  assess  the  efficiency, 
in  terms  of  social  benefits  and  social  costs,  with  which  youths 
programs  achieved  their  effects. 


FINDINGS  AND  CONCLUSIONS  ON  YEDPA  RESEARCH 

We  often  found  it  difficult,  as  noted  above,  to  reach  firm 
conclusions  about  the  effectiveness  of  YEDPA  programs  given  the  qualit 
of  the  available  evidence.  Indeed,  the  difficulty  in  making  inference 


cose  largely  from  the  paucity  of  reliable  evidence  from  the  YEDPA 
esearch  effort.  Careful  readings  even  of  the  few  reports  that  did 
set  minimal  standards  of  methodological  adequacy  frequently  revealed 
portant  flaws  in  the  reported  research. 

It  would  be  unfortunate,  however,  to  conclude  that  rigorous 
esearch  cannot  be  conducted  on  youth  programs.  On  the  contrary,  we 
Dund  several  examples  of  research  studies  on  youth  employment  and 
raining  programs  that  provided  strong  evidence,  both  positive  and 
agative,  on  program  effectiveness  (Job  Corps,  Supported  Work,  and 
ternative  Youth  Employment  Strategies) .  These  examples  indicate  that 
ven  reasonable  time  for  design  and  planning,  attention  to  research 
tandards,  care  in  coordinating  with  program  operators  and  in  program 
mplementation  and  follow-up,  good  evaluations  of  employment  and 
raining  efforts  can  be  executed  for  both  small-  and  large-scale 
rograms . 

While  it  is  relatively  easy  to  point  out  the  methodological 
roblems  in  YEDPA  research  programs,  it  is  more  difficult  to  identify 
heir  causes.  In  the  interests  of  improving  the  quality  of  future 
search,  we  describe  below  some  of  the  common  inadequacies  of  the 
EDPA  research  effort  and  some  of  the  conditions  that,  we  believe, 
ontributed  to  those  failings. 

There  were  a  wide  variety  of  problems  in  YEDPA  research.  Many  are 
bvious  and  reflect  the  difficulty  of  meeting  established  research 
tandards  for  complete  reporting  of  research  results,  documentation  of 
ocedures  for  sample  definition,  presentation  of  details  of  statistical 
nalyses,  adequate  coverage  of  the  target  population  in  data  gathering, 
d  minimal  sample  attrition.  Low  rates  of  initial  sample  coverage  and 
igh  rates  of  sample  attrition,  for  example,  were  among  the  most  common 
laws  of  the  YEDPA  research  reports  we  screened.  Other  problems, 
owever,  are  less  easily  resolved  and  appear  to  be  inherent  in  public 
licy  research. 

Comparison  and  Control  Group  Methodology 

Difficulties  in  identifying  equivalent  comparison  or  control  groups 
lawed  many  YEDPA  studies.  Very  few  of  the  studies  we  reviewed  used 
andom  assignment  to  create  participant  and  control  groups.  A  more 
requent  strategy  was  to  define  or  construct  a  comparison  group  that, 
xcept  for  program  participation,  was  presumed  to  differ  in  no 
mportant  way  from  the  participant  group.  Differences  in  measured 
utcomes  were  then  attributed  to  the  effects  of  program  participation, 
n  some  cases,  statistical  techniques  were  used  to  control  for  measured 
ifferences  between  participants  and  nonparticipants. 

Our  review  of  research  that  used  such  constructed  comparison  groups 
evealed  two  basic  problems  that  repeatedly  jeopardized  the  validity  of 
he  inferences  to  be  drawn.  The  most  frequent  problem  was  the  use  of 
omparison  groups  that  differed  markedly  in  background  characteristics 
rom  participant  groups.  Given  an  adequate  theoretical  model,  differ- 
nces  in  measured  characteristics  can  be  controlled  for  statistically, 
[owever,  when  there  are  substantial  differences  in  measured  character- 


istics  one  becomes  uneasy  about  the  adequacy  of  the  theoretical 
assumptions  and  statistical  adjustments  and  is  left  wondering  about 
major  differences  in  unmeasured  characteristics  that  may  be  correla 
with  the  outcome  measures.  A  second  common  problem  was  the  use  of 
treated  comparison  groups,  i.e.,  groups  receiving  services  similar 
those  provided  to  the  YEDPA  participants  but  in  a  different  prograrr 
Both  of  these  problems  undermined  the  basic  purpose  of  a  comparison 
control  group  and  made  the  attribution  of  program  effects  questions 
The  research  reviewed  in  this  report  demonstrates  the  causes  for  co 
about  bias  in  estimated  effects  from  use  of  such  comparison  groups. 
Because  of  these  problems  we  frequently  found  that  purported  eviden 
of  YEDPA  program  effects  might  plausibly  be  ascribed  to  the  non¬ 
equivalence  of  the  comparison  and  participant  groups,  even  when 
statistical  methods  to  control  for  such  differences  were  used. 

Even  in  the  methodologically  sophisticated  work  conducted  on  th 
CLMS  data  base,  there  is  convincing  evidence  that  the  constructed 
comparison  groups  that  were  equated  on  common  socioeconomic  variabl 
could  differ  markedly  on  important  unmeasured  variables.  The  Job  C 
evaluation  also,  despite  efforts  to  correct  for  biases  in  the  con¬ 
structed  comparison  group,  was  ultimately  less  convincing  in  its 
estimates  of  effects  than  would  have  been  the  case  had  random 
assignment  been  used. 

CONCLUSION:  YEDPA  research  did  not  make  sufficient  use  of 
random  assignment  in  defining  participant  and  control  groups. 
Our  review  of  the  research  on  YEDPA  shows  dramatically  that 
control  groups  created  by  random  assignment  yield  research 
findings  about  employment  and  training  programs  that  are  far 
less  biased  than  results  based  on  any  other  method. 

The  fact  that  some  studies  successfully  used  random  assignment 
suggests  that  this  procedure  is  feasible  and  presents  no  serious 
technical  difficulties  in  execution.  It  is  evident  that  if  random 
assignment  had  consistently  been  used  in  YEDPA  research  much  more  v 
have  been  learned.  (The  use  of  random  assignment  in  public  policy 
research  is  discussed  in  Appendix  C.) 


Measures  of  Implementation 

In  a  real-world  experiment  involving  a  social  program  one  does 
have  a  single,  standardized  treatment.  Hence,  evaluation  of  the 
outcomes  of  such  social  experiments  must  carefully  take  into  accour 
the  nature  of  the  treatment (s)  given  and  variations  between  the 
treatments  received  by  different  individuals.  Without  paying  atter 
to  matters  of  implementation  one  cannot  know  whether  a  given  progrc 
was  successfully  delivered.  If  no  program  approximating  that  inter 
by  its  designers  was  implemented  at  a  given  site,  for  example,  ther 
no  reason  to  treat  the  results  as  a  "test"  of  the  outcomes  arising 
the  program.  We  found  that  although  YEDPA  produced  several  studies 
program  implementation,  YEDPA  research  gave  insufficient  considerai 
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to  measures  of  the  extent  of  program  implementation  in  interpreting  or 
qualifying  program  results. 

The  YEDPA  research  plan  envisioned  gathering  a  standard  set  of  data 
about  the  process  of  program  implementation.  This  plan  included  infor¬ 
mation  on  the  nature  of  the  services  offered  by  different  programs  and 
sites,  the  gearing  up  and  scaling  down  of  operations  over  time,  the 
urnover  of  staff,  the  distribution  and  magnitudes  of  program  expendi¬ 
tures,  and  so  forth.  Unfortunately,  this  effort  was  neither  well 
planned  nor  well  executed  (see  Appendix  A) . 


Length  of  Follow-up  Period 

A  major  shortcoming  of  theoretical  importance  in  YEDPA  research  was 
the  very  short  postprogram  period  over  which  outcomes  were  measured. 

For  most  programs,  follow-up  measures  were  available  only  at  3  or  8 
months  after  program  completion;  Job  Corps  and  Supported  Work,  with 
over  3-year  follow-ups,  were  notable  exceptions.  Given  the  employment 
objectives  of  most  YEDPA  programs,  a  more  reasonable  test  would  have 
considered  longer-term  outcomes. 

The  Job  Corps  experience  of  initial  declines  in  employment  and 
earnings  in  the  first  months  after  termination,  followed  by  significant 
longer-term  gains,  suggests  that,  at  least  for  some  programs,  additional 
ime  may  be  required  for  effects  to  emerge.  On  the  other  hand,  there 
are  examples  (70001  and  JAG)  indicating  that  early  program  effects  may 
decay  rapidly.  Thus,  there  is  evidence  that  short-term  follow-ups  may 
lead  to  incorrect  inferences,  both  positive  and  negative. 

CONCLUSION;  For  the  most  part,  YEDPA  program  evaluation 
research  suffered  seriously  from  the  lack  of  outcome  data 
collected  over  a  sufficiently  long  period  following  program 
completion.  For  some  programs  it  appears  that  there  was  never 
any  serious  intention  to  collect  data  beyond  8  months  post¬ 
program;  for  other  programs,  the  abrupt  cutoff  of  funds  in  1981 
precluded  any  attempt  at  further  follow-up.  It  is  clear  that 
the  long-term  effects  of  programs  cannot  be  measured  when  there 
are  no  data  beyond  8  months.  Neither  policy  makers  nor 
researchers  are  well  served  by  such  truncated  evaluation 
studies . 


Use  of  Subjective  Measurements  as  Proxy  Variables 

Many  YEDPA  research  projects  used  subjective  measurements,  such  as 
measures  of  work-related  attitudes  and  job-holding  skills,  as  proxies 
for  longer-term  outcomes.  As  with  all  such  measures,  the  link  between 
the  proxy  variable  (the  social  attitude  or  skill)  and  the  unmeasured 
long-term  outcome  variable  (increased  employment  and  earnings)  is 
subject  to  empirical  verification.  It  is  important  to  ask  how  well 
these  variables  serve  as  proxies  for  the  variables  of  primary  interest. 
(Appendix  A  reviews  the  correlations  between  the  subjective  measures 


used  as  proxies  in  YEDPA  research  and  measures  of  employment  and 
earnings  variables.)  We  found  that  these  measurements  showed  relatively 
low  correlations  with  the  objective  variables  for  which  they  were 
intended  to  serve  as  proxies  and  that  the  reliability  of  these  YEDPA 
measurements  was  rather  low.  Furthermore,  an  earlier  analysis  of  data 
on  the  same  measures  collected  prior  to  the  3-  and  8-month  data 
collection  periods  was  predictive  of  these  low  correlations  and 
reliabilities. 

CONCLUSION:  YEDPA  evaluations  invested  large  amounts  of 
resources  in  measurement  of  proxy  variables  rather  than  the 
real  variables  that  were  the  goals  of  the  programs.  Moreover, 
most  of  these  were  subjective  measures  known  to  have  only 
modest  levels  of  association  with  the  objective  outcomes  that 
were  the  implicit  long-term  goals  of  the  YEDPA  programs — future 
employment  and  earnings. 


Sample  Undercover age  and  Attrition 

Sample  undercoverage  and  sample  attrition  were  two  of  the  most 
critical  and  frequent  problems  with  YEDPA  research.  Indeed,  attrition 
between  waves  of  a  study  was  second  only  to  lack  of  impact  data  as  a 
reason  for  excluding  reports  from  our  review.  In  addition,  over  the 
range  of  YEDPA  programs  covered  by  the  Standardized  Assessment  System, 
it  is  estimated  that  data  were  gathered  from  less  than  half  of  the 
target  sample.  This  undercoverage  makes  it  impossible  to  generalize  to 
the  total  population  of  participants  in  YEDPA  demonstration  projects 
unless  one  makes  highly  unrealistic  assumptions,  for  example,  that 
nonresponders  were  a  random  sample  of  program  participants. 

CONCLUSION:  Many  YEDPA  research  projects  gave  inadequate 
attention  to  sample  design  and  execution,  including  defining 
the  sampled  population,  obtaining  data  from  all  members  of  the 
target  sample,  and  preventing  sample  attrition  between  waves  of 
the  longitudinal  data  gathering. 

It  is  important  that  the  foregoing  catalog  of  problems  with  YEDPA 
research  not  lead  readers  to  the  despairing  conclusion  that  such 
problems  are  unavoidable  for  all  evaluation  research  in  the  employment 
and  training  field.  We  found  that  these  problems  were  not  predestined 
by  the  nature  of  the  questions  being  posed,  but  rather  were  caused  by 
the  demands  of  Congress  for  research  results  and  the  failure  of  the 
researchers  to  recognize  the  limits  imposed  by  YEDPA  conditions  and 
scale  the  research  accordingly.  The  research  tools  available  are  ade¬ 
quate  to  the  task,  but  suitable  conditions  for  their  use  must  be 
provided.  These  conditions  include  adequate  time  for  design  and 
execution  of  the  research,  reasonable  stability  of  the  programs  being 
evaluated,  provision  of  adequate  resources  for  the  research,  and  a 
political  commitment  on  the  part  of  those  commissioning  the  research  to 
allow  adequate  time  not  only  for  careful  planning  at  the  beginning,  but 


OVERALL  CONCLUSIONS:  DID  YEDPA  ACHIEVE  ITS  GOALS? 


The  YEDPA  legislation  had  four  major  objectives  that  broadly 
iefined  its  scope:  (1)  to  address  the  immediate  employment  needs  of 
souths  through  job  creation  efforts;  (2)  to  conduct  research  and 
lemonstration  as  a  means  of  identifying  methods  of  dealing  with  the 
structural  employment  problems  of  youths;  (3)  to  involve  other 
igencies,  nationally  and  locally,  in  the  planning  and  delivery  of  youth 
employment  services  as  a  means  of  exploring  the  effectiveness  of 
ilternative  service  delivery  mechanisms;  and  (4)  to  increase 
cooperation  between  the  schools  and  the  employment  and  training  system 
is  a  means  of  addressing  the  problems  of  disadvantaged  youths,  we 
present  here  our  conclusions  on  the  extent  to  which  these  objectives 
ere  met. 


Job  Creation 

A  key  objective  of  YEDPA,  the  one  on  which  the  most  funds  were 
pent,  was  providing  young  people  with  jobs.  In  response  to  high  youth 
nemployment  in  the  1970s,  federal  outlays  for  youths  in  the  first  year 
'f  YEDPA  doubled  what  they  had  been,  and  in  its  course  YEDPA  served 
ver  6  million  youths.  Previous  efforts  at  large-scale  jobs  programs 
SYEP  and  Public  Service  Employment)  were  widely  criticized  for  their 
oor  administration  and  poor  job  quality  (U.S.  General  Accounting 
•ffice,  1979)  .  Evaluations  of  massive  jobs  programs  under  YEDPA  (SYEP 
nd  entitlement)  showed  major  improvements  in  job  supervision  and  job 
uality.  There  is  evidence  not  only  that  very  large  numbers  of  jobs 
ere  provided  to  youths  under  YEDPA,  but  also  that  the  quality  of  the 
obs  was  more  than  "make-work." 

CONCLUSION:  A  major  achievement  of  YEDPA  was  that  it  succeeded 
in  providing  large  numbers  of  disadvantaged  youths  with  jobs 
that  were  more  than  make-work.  YEDPA  demonstrated  the  capacity 
of  the  employment  and  training  system  to  mount  and  run 
large-scale  jobs  programs  for  young  people. 


Research  and  Demonstration 

Although  the  employment  and  training  system  under  YEDPA  was  able  to 
iemonstrate  its  capacity  for  implementation  and  operation  of  large- 
;cale  programs,  it  was  hampered  in  its  response  to  its  second  major 
bjective — conducting  research  and  demonstration  aimed  at  solving  the 
itructural  employment  problems  of  youths.  Our  review  suggests  that  the 
.nstitutional  capacity  for  research  and  demonstration  was  insufficient 
:o  the  objectives  of  YEDPA  knowledge  development.  The  knowledge 


development  agenda  itself  was  too  ambitious  given  the  rapid  time 
schedule  of  YEDPA  and  the  other  demands  of  large  jobs  programs.  In 
terms  of  the  results  of  YEDPA  research,  the  youth  employment  situatio: 
today  is  not  very  different  from  what  it  was  before  YEDPA  began. 

CONCLUSION:  Rapid  program  expansion  in  a  period  of  considerable 
social  program  activity  severely  hampered  the  planning,  imple¬ 
mentation,  and  evaluation  of  YEDPA  demonstration  research.  The 
abrupt  halt  of  research  activity  in  1981  did  not  help.  As  a 
result,  despite  the  magnitude  of  the  resources  ostensibly 
devoted  to  the  objectives  of  research  and  demonstration,  there 
is  little  reliable  information  on  the  effectiveness  of  the 
programs  in  solving  youth  employment  problems. 


Developing  the  System 

The  youth  employment  and  training  system  has  long  suffered  from  i 
isolation  from  major  economic  and  educational  institutions.  This 
isolation  is  due  to  a  number  of  factors,  most  importantly  the  charact 
of  its  client  population  and  its  lack  of  a  stable  institutional  base. 
The  YEDPA  legislation  required  the  involvement  of  private  employers, 
the  schools,  and  other  established  agencies,  both  public  and  private, 
in  planning  and  delivering  youth  services  in  order  to  explore  alter¬ 
native  mechanisms  for  more  effective  service  delivery  and  to  encourag* 
the  integration  of  employment  and  training  services  into  the  mainstre, 
of  the  society. 

Our  review  of  numerous  reports  on  program  effectiveness  and 
implementation  suggests  that  although  the  involvement  of  these  parties 
was  effective  in  making  better  use  of  local  resources,  it  complicated 
the  planning  and  delivery  process  and  did  not  on  the  whole  achieve  its 
goals  of  improving  service  delivery  and  integrating  either  the  prograi 
or  their  participants  into  the  larger  society. 

Given  the  nature  of  the  youth  employment  problem,  the  goals  of 
equity  and  efficiency  argue  for  targeting  services  to  disadvantaged 
youths.  At  the  same  time,  however,  our  review  suggests  that  the  youtl 
employment  and  training  system  continues  to  suffer  from  a  marginal 
status  that  is  due  in  part  to  such  targeting. 

CONCLUSION:  Despite  YEDPA  efforts  to  improve  the  service 
delivery  system,  employment  and  training  services  for  youths 
remain  economically,  socially,  and  racially  isolated  from  the 
larger  society  and  its  institutions.  This  isolation  has 
stigmatized  the  programs  and  undercut  their  ability  to  recruit 
staff,  motivate  participants,  and  involve  employers. 


The  Schools  and  School  Dropouts 

The  YEDPA  requirement  that  22  percent  of  the  funds  for  YETP  be  se 
aside  for  programs  coordinated  with  the  local  school  system  was  an 
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ittempt  to  influence  the  schools  to  broaden  their  constituency  to 
Include  disadvantaged  youths.  Despite  the  agreements  negotiated  under 
fEDPA  to  involve  the  schools  in  youth  employment  programs,  we  found 
Little  evidence  of  successful  mutual  efforts. 

CONCLUSION:  The  relationship  between  the  employment  and 
training  system  and  the  school  system  remains  problematic. 

Despite  some  common  objectives  and  client  groups  and  efforts  to 
bring  the  two  systems  together  in  the  service  of  those 
objectives  and  clients,  they  remain  largely  separate,  and  the 
potential  benefits  of  mutual  efforts  are  largely  unrealized. 

An  example  of  this  problem,  and  one  of  great  importance  to  this 
committee,  is  the  problem  of  school  dropouts — a  group  of  legitimate 
concern  to  both  the  schools  and  the  employment  and  training  system  and 
a  group  that  neither  has  been  able  to  serve  effectively.  No  other 
fouth  group  faces  the  employment  problems,  both  immediate  and  long 
term,  faced  by  school  dropouts,  and  particularly  those  who  are  minority 
iroup  members. 

The  YEDPA  approach  to  the  dropout  problem  was  twofold:  (1) 
>revention  of  the  problem  by  targeting  services  to  youths  at  risk  of 
Iropping  out  and  giving  them  incentives  to  remain  in  school  and  (2) 
emediation  of  the  problem  by  targeting  services  directly  to  dropouts 
.n  a  way  that  encouraged  return  to  school  or  an  alternative  education. 
)ur  review  of  youth  programs  found  no  evidence  of  effective  means  of 
either  dropout  prevention  or  remediation.  We  observed  instead  the 
severe  problems  of  schools  and  other  program  operators  in  recruiting 
md  retaining  dropout  youths  and  the  tendency  of  those  programs  to 
iocus  their  services  on  the  more  easily  recruited  and  served  population 
>f  in-school  youths. 

CONCLUSION:  Of  all  youth  groups,  school  dropouts  face  the  most 
serious  employment  problems.  Because  of  problems  in  recruiting 
and  serving  dropouts,  however,  the  focus  of  youth  research  and 
demonstration  under  YEDPA  was  unduly  directed  to  in-school 
youths  and  high  school  graduates.  As  a  result,  the  question  of 
how  to  reach  and  serve  dropout  youths  remains  unanswered. 


IMPLICATIONS  AND  RECOMMENDATIONS 

Two  basic  issues — the  problem  of  school  dropouts  and  the  relations 
between  the  schools  and  the  employment  and  training  system — remain,  in 
the  committee's  view,  fundamental  dilemmas  confronting  the  youth  employ- 
aent  and  training  system  in  the  United  States.  We  begin  our  discussion 
Df  implications  with  our  recommendations  for  future  youth  policy  with 
regard  to  dropouts . 

We  recognize  that  there  is  a  long  history  of  research  and  program 
ittempts  to  understand  and  deal  with  the  problems  of  school  dropouts. 
\nd  yet,  as  our  review  strongly  suggests,  dropouts,  particularly 
ainority  group  dropouts,  remain  as  the  segment  of  the  youth  population 
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Youth  Programs 
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idered  judgment,  the  clearest  lesson  from  the  YEDPA  experience 
oncerning  effective  programs  is  that  much  remains  to  be  learned  about 
ealing  with  youth  employment  problems.  In  our  judgment,  it  is  better 
y  far  to  admit  that  knowledge  is  lacking  than  to  assume  on  the  basis 
scant  knowledge  that  we  know  what  works  best  for  whom.  Therefore, 
ur  recommendations  on  programs  and  program  research  are  closely  tied 
the  evidence  we  reviewed.  In  this  section  we  first  present  our 
rogram  recommendations  for  out-of -school  youths,  then  for  in-school 
ouths,  and  finally  for  programs  serving  women. 

rograms  for  Out-of-School  Youths 

The  results  of  our  review  and  the  present  conditions  of  the  new  Job 
raining  Partnership  Act  (enacted  in  1982)  suggest  the  following 
rogram  areas  for  research  for  out-of-school,  dropout  youths:  basic 
emedial  education,  occupational  skills  training,  and  financial 
ssistance. 


asic  Education  Although  there  is  no  evidence  on  the  effect  of  labor 
arket  preparation  programs  on  basic  skills  acquisition,  there  is 
vidence  from  the  Job  Corps  and  70001  that  programs  placing  a  strong 
mphasis  on  GED  training  can  substantially  increase  the  educational 
ttainment  of  out-of-school  youths,  as  measured  by  GED  attainment. 

RECOMMENDATION:  The  importance  of  basic  education  as  a 

component  of  programs  for  out-of-school  youths  should  be  tested 
systematically.  Many  programs  have  placed  heavy  emphasis  on 
the  attainment  of  a  GED  (or  other  educational  interventions 
such  as  competency-based  instruction)  for  this  group  and  a 
serious  attempt  should  be  made  to  determine  whether  the 
increase  in  basic  education  provided  through  programs  does  in 
fact  have  long-term  payoffs  for  these  youths. 


>ccupational  Skills  Training  The  results  of  the  Job  Corps  evaluation 
uggest  that  occupational  skills  training  programs  can  be  an  effective 
leans  of  solving  some  of  the  structural  employment  problems  of  dis- 
dvantaged  out-of-school  youths,  at  least  of  that  population  of 
tisadvantaged  dropout  youths  served  in  residential  Job  Corps  centers, 
’he  fact  that  the  research  to  date  has  not  explained  the  Job  Corps' 
iffects  in  terms  of  the  individual  contribution  of  its  many  program 
:omponents  or  the  totality  of  its  residential  services,  limits  the 
[eneralizability  of  the  results  to  other  disadvantaged  youths  in  other 
lettings . 

RECOMMENDATION:  Opportunities  to  enroll  in  the  Job  Corps 

should  continue  to  be  provided  for  the  out-of-school  youth 
population. 
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either  the  program  or  to  a  control  group.  Even  with  random  assign- 
\t  to  a  limited  number  of  part-time  jobs  for  in-school  youths  during 
s  school  year,  if  the  program  is  focused  on  those  areas  where  ethnic 
:ferentials  in  employment  of  in-school  youths  are  high,  the  results 
the  test  programs  would  provide  evidence  as  to  whether  a  narrowing 
in-school  employment  differentials  will  lead  to  a  subsequent 
crowing  of  postschool  employment  differentials. 

RECOMMENDATION:  Programs  should  be  designed  to  test  whether 
increased  in-school  employment  leads  to  greater  postschool 
employment.  The  tests  should  be  conducted  in  a  form  that 
requires  random  assignment  of  individuals  to  the  program  or  a 
control  group.  The  evaluation  of  the  test  programs  should 
provide  sufficiently  long-term  follow-up  data  for  both 
participants  and  control  group  members  to  determine  long-term 
postschool  effects. 


The  Summer  Youth  Employment  Program  seems  to  have  sufficient 
Litical  popularity  to  survive  regardless  of  evaluation  research 
tidings  or  nonfindings.  Therefore,  attempts  should  be  made  to 
structure  segments  of  SYEP  to  provide  an  opportunity  to  learn  more 
out  whether  its  resources  can  be  used  more  effectively. 

RECOMMENDATION:  Attempts  should  be  made  to  restructure  some 
elements  of  the  Summer  Youth  Employment  Program  to  systemati¬ 
cally  test  whether  SYEP  elements  can  be  used  to  enhance  basic 
education  sufficiently  to  reduce  school  dropout  rates  or,  at 
least,  improve  employment  chances  for  those  who  do  drop  out 
anyway.  Elements  of  SYEP  could  be  structured  so  some  skills 
training  is  added  to  the  pure  work  experience  in  order  to 
determine  whether  such  training  enhances  the  long-term 
employment  effects  of  the  program. 


nen  in  Youth  Employment  Programs 

Although  women  constitute  half  of  the  participants  in  employment 
1  training  programs,  little  attention  has  been  given  to  sex 
fferences  either  in  terms  of  program  needs  or  outcomes.  Yet  it  is 
ear  that  the  distinct  needs  and  characteristics  of  this  group  have 
plications  for  program  design. 

RECOMMENDATION;  Programs  should  be  designed  to  recognize  more 
fully  the  fact  that  teenage  parenthood  often  results  in 
restricting  the  educational,  training,  and  employment  oppor¬ 
tunities  of  young  women.  The  benefits  of  providing  child  care 
to  encourage  greater  participation  of  teenage  mothers  and  more 
favorable  program  outcomes  should  be  rigorously  tested. 


In  addition,  while  there  is  some  indication  that  women  benefit  more 
om  participation  in  employment  and  training  programs  than  men,  there 
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The  strategy  would  be  to  provide  through  some  central  mechanism  the 
search  designs  and  technical  assistance  that  would  be  necessary  to 
l  evaluation  components  to  youth  programs  being  underwritten  by  local 
Lvate  Industry  Councils  (PICs)  and  Service  Delivery  Areas  (SDAs) 
ough  JTPA.  Adding  a  small  amount  of  program  funds,  allocated  on  a 
scretionary  basis  to  those  PICs  and  SDAs  that  agree  to  cooperate, 
iht  induce  the  localities  to  make  the  slight  alterations  in  their 
)gram  content  or  procedures  necessary  for  evaluation  research. 

The  central  agency  would  have  the  overall  perspective  the  local 
:s  and  SDAs  may  lack  as  to  the  range  of  program  types  that  are  being 
lertaken  in  various  localities  and  would  ensure  that  a  reasonable 
rtfolio  of  quality  evaluations  was  being  mounted  so  that  the  relative 
lectiveness  of  different  program  types  could  be  assessed.  Having 
Ls  perspective  would  also  enable  the  central  agency  to  provide  inf or - 
:ion  and  technical  assistance  to  the  local  PICs  and  SDAs  concerning 
:ernative  program  types,  better  program  procedures,  and  so  on.  The 
itral  agency  would  also  help  to  ensure  that  at  least  a  central  core 
the  evaluation  research  information  collected  across  sites  was 
isonably  comparable  so  that  cross-program  comparisons  could 
sntually  be  made. 

The  central  agency  need  not  be  in  the  federal  government  itself. 

1  experience  with  the  use  of  intermediary  organizations  to  organize 
search  and  technical  assistance  under  YEDPA,  while  it  was  not  all 
;itive,  was  sufficiently  good  in  a  number  of  cases  to  suggest  that 
Ls  might  be  an  effective  medium  through  which  to  interject  this 
iluation  research  into  the  JTPA  framework.  Such  organizations  now 
re  experience  in  negotiating  with  local  operating  agencies,  adapting 
search  designs  to  local  constraints ,  and  combining  technical 
sistance  with  research  guidance.  While  the  major  activity  could  be 
ried  out  through  an  intermediary,  some  guidance  and  oversight  from 

2  Department  of  Labor  is  necessary,  as  we  noted  in  our  earlier 
.cussion  of  YEDPA;  it  is  not  wise  to  devolve  responsibility  totally 
an  intermediary.  But  with  a  level  of  research  and  evaluation 
:ivity  that  would  be  only  a  small  fraction  of  that  undertaken  under 
DP  A,  the  Department  of  Labor  staff  required  to  oversee  inter- 
liaries"  activities  could  be  quite  small. 

We  note  also  that  good  evaluative  research  could  provide  a  sounder 
sis  for  the  setting  of  performance  standards,  a  key  feature  of  JTPA. 
at  is  important  for  performance  is  value  added,  the  improvement  in 
>loyment  and  earnings  over  what  it  would  have  been  in  the  absence  of 
2  program,  and  we  would  argue  that  this  can  best  (and  perhaps  only) 
established  through  evaluation  research  using  randomly  assigned 
itrol  groups. 

These  then  are  just  the  rough  outlines  of  a  strategy  and  mechanism 
:  evaluation  research  on  youth  programs  under  JTPA.  We  believe  they 
2  compatible  with  the  basic  design  of  JTPA  itself  and  could  yield 
>d  evidence  from  the  JTPA  experience  about  how  an  employment  and 
lining  system  can  better  help  alleviate  the  continuing  serious 
sloyment  problems  of  sizable  proportions  of  our  youths.  We  must 
cess  that  in  the  absence  of  such  a  strategy  and  mechanism,  we  believe 
it  several  years  from  now  the  nation  will  find  itself  with  several 


Research  Methods 


research  andhL2^at'w^,r^,t“*“  ^  f  "ested  f°r 
components  we  have  recommended  we  hf,V  ,the  types  of  Program 

make  about  the  actual  conduct  of  reselrch^nd  f' scon™endations  to 

pie  results  of  our  review  of  yedpa  ntc  equation  activities, 
quality  in  the  design  and  execution  of  P  ®rams  make  it  obvious  that 
quality  of  the  data  3andntheXreuiMl?fvaoferarCh  Pr°jeCt  affeots  “ 
drawn  from  those  data.  Poor  research  L«f  *  conclusi°us  that  are 
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Random  Assignment 


havet^rieaTnel/fnTmor^^onfiden^:"1!  that  «*•  « 

assignment  had  more  frequently  been  used13^  £"  th®  results'  if  rai 

the  feasibility  of  random  assignment  in  n  belleve  that  not  only 

strated,  but  that  in  situations  in  whiou^ ^  9ram  research  been  demon- 

and  program  effectiveness  unproven  i£  resources  are  scare 

nproven,  it  is  ethical  (see  Appendix  c) . 
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Implementation  Research 

research  ifcleLr^iTas  imp^uT- implen,entati°n  in  evaluation 
is  measurement  of  dose  level  SOCial  Pro9ram  evaluation  a 
have  had  substantial  experience  in  elicit?  neW  drugs‘  federal  agenci 
information  has  not  always  been  rea=c  ^bln?  suoh  information,  but  t± 
review  of  youth  employment  Xr  ^l^ionV^^ '  jUd*ln9  £ 


:hodological  challenge  to  develop  measures  that  have  substantial 
idity  and  reliability.  Indeed,  the  treatment  of  subjective 
isurements  has  been  reconsidered  in  recent  years,  and  it  is  generally 
ognized  that  common  research  practices  ignore  the  complexity  of  the 
.ationships  between  objective  and  subjective  measurements. 

RECOMMENDATION:  Future  researchers  should  avoid  overreliance 
on  subjective  measures  of  program  outcomes  and  devote  more 
resources  to  studying  the  relationships  that  exist  between 
subjective  indicators  and  key  objective  outcome  variables. 


tprogram  Follow-up 

The  Job  Corps  evaluations  suggest  that  some  program  effects  that 
:  not  apparent  at  short-term  follow-ups  may  emerge  in  the  longer 
:m.  Research  on  job  placement  programs  suggests  that  some,  more 
lediate,  postprogram  effects  may  decay  rapidly.  Together,  these 
ices  of  evidence  suggest  that  short-term  follow-up  data  may  err 
her  positively  or  negatively  in  predicting  longer-term  program 
"ects . 

RECOMMENDATION:  Future  research  on  the  effectiveness  of  youth 
employment  and  training  programs  should,  at  least  in  selected 
studies,  estimate  the  longer-term  effects  of  these  programs  by 
collecting  follow-up  data  for  at  least  2  years  postprogram. 


lefit-Cost  Studies 

When  evaluations  demonstrate  that  programs  have  a  positive  outcome, 
;earchers  should  recognize  that  the  next  question  raised  will  be 
ither  this  positive  outcome  was  worth  what  it  cost  to  produce  it. 
is  evaluators  should  anticipate  the  eventual  need  for  benefit-cost 
idies.  Such  studies,  however,  need  not  be  a  component  of  every 
iluation  nor  of  entire  programs,  since  doing  adequate  benefit-cost 
idies  is  both  difficult  and  costly. 


t  Job  Training  Longitudinal  Survey  Data  Base 

One  feature  of  JTPA  that  is  important  in  regard  to  program  research 
the  plan  to  rely  heavily  on  analysis  of  national  data  bases  to 
:ermine  the  effectiveness  of  JTPA  programs.  Present  plans  are  to 
lei  the  Job  Training  Longitudinal  Survey  (JTLS)  data  base  after  the 
jvious  CLMS .  Although  its  data  gathering  appeared  technically 
:ellent,  the  CLMS  strategy  of  using  nonrandom  comparison  groups  for 
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program  evaluation  suffered  from  substantial  problems  with  potential 
unmeasured  biases  in  its  comparison  groups.  Furthermore,  we  believe 
that  the  plan  to  use  the  same  strategy  in  designing  the  JTLS  as  a  means 
of  obtaining  evidence  on  "what  works  for  whom"  is  misguided.  The 
evaluations  we  reviewed  that  are  based  on  constructed  comparison  groups 
provide  strong  evidence  that  this  approach  to  program  evaluation  is 
seriously  flawed;  the  question  of  bias  in  comparison  groups  so  con¬ 
structed  is  virtually  impossible  to  dispel.  We  believe  that  the 
planned  JTPA  evaluations  using  the  new  JTLS  will  suffer  from  the  same 
problems . 

RECOMMENDATION:  Planning  for  the  JTLS  should  give  very  serious 
consideration  to  the  selection  of  randomized  control  groups. 

In  conclusion,  we  believe  that  quality  research  ought  to  be  recog¬ 
nized  and  ought  to  be  explicit  in  congressional  and  agency  oversight 
policy.  Special  efforts  should  be  made  to  improve  the  quality  of 
research  and  evaluation  designs  for  estimating  the  impact  of  youth 
employment  projects.  Existing  professional  guidelines  can  be  used  to 
influence  quality  of  design  as  well  as  quality  of  research  execution 
and  reporting. 

RECOMMENDATION:  The  committee  recommends  the  following 
conditions  as  necessary  but  not  sufficient  for  quality  research: 

(1)  the  use  of  random  assignment  to  participant  and  control 
groups  and  to  program  variations;  (2)  reasonable  operational 
stability  of  the  program  prior  to  final  assessment  of  effec¬ 
tiveness;  (3)  adequate  sample  coverage  and  low  rates  of  sample 
attrition;  (4)  outcome  measures  that  adequately  represent  the 
program  objectives,  both  immediate  and  longer  term;  and  (5)  a 
follow-up  period  that  allows  adequate  time  for  program  effects 
to  emerge  or  decay. 


The  General  Conduct  of  Public  Policy  Research 

One  of  the  major  implications  of  our  review  of  YEDPA  programs  and 
research  concerns  the  conduct  of  national  public  policy  research  and 
demonstration  programs.  It  was  very  apparent  in  our  review  that  many 
of  the  problems  we  faced  in  attempting  to  draw  inferences  from  YEDPA 
research  resulted  from  the  fact  that  under  YEDPA  attempts  were  made  to 
combine  numerous  research  objectives  with  massive  service  delivery. 

The  consequent  tensions,  conflicts,  and  overload  on  the  system  inter¬ 
fered  with  the  careful  planning  and  conduct  of  the  research  and 
demonstration  activities,  with  the  result  that  the  research  findings 

fall  short  in  informing  the  public  policy  issues  from  which  YEDPA 
originated . 

RECOMMENDATION:  In  future  efforts  the  objectives  of  research 
and  demonstration  should  be  more  clearly  and  selectively 
focused  on  essential  public  policy  issues  and  clearly  separated 
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from  the  objectives  of  massive  service  delivery.  The  magnitude 
of  the  effort  and  the  expectation  of  results  should  be  more  in 
scale  with  limitations  of  time,  money,  and  staff  resources* 


Dilemmas  Confronting  the  Employment  and  Training  System 

In  closing,  we  return  to  the  two  fundamental  dilemmas  with  which  we 
an  this  discussion  of  implications  and  recommendations  for  the 
stem  of  employment  and  training  in  the  United  States.  The  employment 
i  training  system  is  trying  in  large  part  to  do  what  the  education 
stem  should  be  doing  but,  for  some  significant  segment  of  the  youth 
>ulation,  apparently  fails  to  do.  Yet  the  employment  and  training 
stem  has  not  attained  stability  of  funding,  professionalization  of 
ff,  and  delineation  of  authority,  in  short,  institutionalization  of 
i  sort  that  has  given  the  educational  system  its  accepted  place  in 
i  mainstream  of  American  life.  As  a  result,  in  most  communities, 
janizations  involved  in  employment  and  training  are  considered 
ginal.  The  educational  system,  on  the  other  hand,  should  not  be 
;en  as  an  exact  model  for  the  institutionalization  of  the  employment 
[  training  system,  since  it  has  not  yet  found  an  effective  way  to 
spare  a  substantial  segment  of  the  youth  population  for  later 
>loyment . 

For  the  most  part,  the  youth  programs  of  the  employment  and 
lining  system  have  been  specifically  targeted  toward  special  segments 
the  youth  population,  often  those  perceived  as  most  disadvantaged, 
en  that  the  major  rationale  for  youth  programs  within  the  employment 
1  training  system  is  to  assist  those  whom  the  educational  system  has 
.led  to  prepare  for  work,  this  target  seems  a  sensible  means  to  focus 
'ources  on  those  in  greatest  need.  The  problem  is  that  this  very 
geting  tends  to  create  an  image  of  the  programs  as  designed  only  for 
iilures;"  both  the  programs  themselves  and  their  clientele  become 
.gmatized  in  the  process.  The  staff  of  the  programs  may  come  to  feel 
Lgmatized  as  well  and  this  can  exacerbate  problems  of  recruitment, 
:ention,  and  management.  Even  the  potential  target  group  members  can 
ne  to  share  the  views  of  the  broader  community  about  the  inherent 
ginality  of  these  programs  and  the  stigmatizing  effects  of  partici- 
;ing  in  them,  and  it  becomes  increasingly  difficult  to  enlist  them  in 
>  programs  and  to  keep  them  participating  for  sufficient  time  for  the 
:ogram  treatment  to  take  hold."  Yet,  experience  has  shown  that  when 
>grams  are  not  targeted,  the  resources  tend  to  be  shifted  rapidly  to 
5  more  advantaged,  better  prepared,  easier  to  handle  segment  of  the 
ith  population — those  who  have  far  less  need  for  help  with  potential 
ployment  problems. 

These  fundamental  dilemmas  pose  a  major  impediment  to  solving  the 
:ious  unemployment  problem  of  youths,  and  we  emphasize  again  the  need 
:  a  direct  study  of  the  roles  and  relationships  of  the  education  and 
i  employment  and  training  systems. 
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Youth  Employment  and  Unemploy mer 


THE  YOUTH  EMPLOYMENT  PROBLEM:  ITS  NATURE  AND  DIMENSIONS 

Unemployment  Rates 

The  United  States  recently  experienced  its  most  serious  unem; 
problems  since  the  Great  Depression  of  the  1930s.  In  the  depths 
this  recession,  in  December  1982,  the  overall  unemployment  rate 
a  postwar  high  of  10.8  percent.  But  the  unemployment  rate  for  t 
was  24.5  percent — more  than  twice  the  overall  rate — and  the  unem 
rate  for  black  teenagers  was  49.5  percent.  Since  the  trough  of 
recession,  the  national  employment  situation  has  improved  somewh 
that  during  1984  the  unemployment  rate  averaged  7.5  percent.  Th 
for  teenagers  was  still  substantially  higher — 18.9  percent — and 
rate  for  black  teenagers  had  improved  only  slightly,  to  42.7  per 

The  youth  employment  problem  is  not  due  merely  to  the  greate 
vulnerability  of  young  workers  to  the  swings  of  the  business  eye 
There  has  been  a  long-term  upward  trend  in  youth  unemployment  ra 
over  the  last  several  decades  (Congressional  Budget  Office,  1982 
Table  2.1a  provides  statistics  for  four  periods  from  1957  to  198 
1957,  1964,  and  1978  were  chosen  because  they  were  years  of  rela 
high  economic  activity  and  had  identical  unemployment  rates  for 
white  men  aged  35-44. 

Over  the  period  spanned  by  these  statistics,  the  unemploymen 
for  all  youths  climbed  steadily.  In  addition,  the  gap  between  w 
and  nonwhite  youths  that  was  evident  in  1957  became  much  larger 
these  decades.  Thus,  even  among  the  more  "settled"  20-  to  24-ye 
youths,  the  1957  unemployment  rate  for  white  males  was  7.1  perce 
while  the  rate  for  nonwhites  was  12.7  percent?  by  1984,  this  gap 
expanded  to  9.8  percent  for  whites  and  24.5  percent  for  nonwhite 
women  aged  20-24,  the  unemployment  gap  had  expanded  similarly,  f 
percent  for  whites  and  12.2  percent  for  nonwhites  in  1957  to  8.8 
for  whites  and  23.5  percent  for  nonwhites  in  1984. 

Table  2,1b,  which  compares  the  unemployment  rates  for  young 
males  with  other  youths,  shows  that  nonwhite  females  aged  20-24 
1.7  times  as  likely  as  white  males  to  be  unemployed  in  1957;  by 
they  were  2.4  times  as  likely  to  be  unemployed.  In  contrast,  wh 
females  have  in  most  years  been  less  likely  to  be  unemployed  tha 
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TABLE  2.1a  Youth  Unemployment  Rates  in  the  Civilian 
Population  for  Selected  Years  (in  percentages) 


Year 

Group 

1957 

1964 

1978 

1984 

Adult  white  males 


35-44  years  old 

2.5 

2.5 

2.5 

4.6 

All  youths 

16-17  years  old 

12.5 

17.8 

19.3 

21.2 

18-19  years  old 

10.9 

14.9 

14.2 

17.4 

20-24  years  old 

7.1 

8.3 

9.6 

11.5 

White  males 

16-17  years  old 

11.9 

16.1 

16.9 

19.7 

18-19  years  old 

11.2 

13.4 

10.8 

15.0 

20-24  years  old 

7.1 

7.4 

7.7 

9.8 

Nonwhite  males 

16-17  years  old 

16.3 

25.9 

39.8 

39.8 

18-19  years  old 

20.0 

23.1 

30.7 

38.5 

20-24  years  old 

12.7 

12.6 

20.0 

24.5 

Hispanic  males 

16-17  years  old 

a 

a 

27.5 

30.5 

18-19  years  old 

a 

a 

13.9 

21.6 

20-24  years  old 

a 

a 

9.4 

12.1 

White  females 

16-17  years  old 

11.9 

17.1 

17.1 

17.8 

18-19  years  old 

7.9 

13.2 

12.4 

13.6 

20-24  years  old 

5.1 

7.1 

8.3 

8.8 

Nonwhite  females 

16-17  years  old 

18.3 

36.5 

41.5 

42.2 

18-19  years  old 

21.3 

29.2 

36.3 

36.6 

20-24  years  old 

12.2 

18.3 

21.3 

23.5 

Hispanic  females 

16-17  years  old 

a 

a 

29.9 

25.2 

18-19  years  old 

a 

a 

16.6 

21.4 

20-24  years  old 

a 

a 

13.0 

12.5 

NOTE:  The  years  1957,  1964,  and  1978  were  selected  because  in 
each  of  these  years  the  unemployment  rate  for  white  males  aged 
35-44  was  an  identical  2.5  percent  and  the  business  cycle  was 
about  at  its  peak;  1984  was  selected  to  provide  a  view  of 
recent  youth  unemployment. 

aNo  data  for  persons  of  Hispanic  origin  are  available  for 
1957  or  1964. 


SOURCE:  Data  from  U.S.  Department  of  Labor  (1982,  1985b) 


TABLE  2.1b  Ratios  Between  Unemployment  Rates  for  Young  Whit 
Males  and  Other  Groups 


Year 

Group 

1957 

1964 

1978 

1984 

White  males 

16-17  years  old 

1.0 

1.0 

1.0 

1.0 

18-19  years  old 

1.0 

1.0 

1.0 

1.0 

20-24  years  old 

1.0 

1.0 

1.0 

1.0 

Nonwhite  males 

16-17  years  old 

1.41 

1.61 

2.36 

2.02 

18-19  years  old 

1.74 

1.72 

2.84 

2.57 

20-24  years  old 

1.79 

1.70 

2.60 

2.50 

Hispanic  males 

16-17  years  old 

a 

a 

1.63 

1.52 

18-19  years  old 

a 

a 

1.29 

1.44 

20-24  years  old 

a 

a 

2.60 

1.23 

White  females 

16-17  years  old 

1.03 

1.06 

1.01 

.90 

18-19  years  old 

.69 

.99 

1.15 

.91 

20-24  years  old 

.72 

.96 

1.08 

.90 

Nonwhite  females 

16-17  years  old 

1.59 

2.27 

2.46 

2.14 

18-19  years  old 

1.85 

2.18 

3.36 

2.44 

20-24  years  old 

1.71 

2.47 

2.77 

2.40 

Hispanic  females 

16-17  years  old 

a 

a 

1.77 

1.28 

18-19  years  old 

a 

a 

1.54 

1.43 

20-24  years  old 

a 

a 

1.69 

1.28 

NOTE:  The  years  1957, 

1964,  and 

1978  were 

selected 

because 

in  each  of  these  years  the  unemployment  rate  for  white 
males  aged  35-44  was  an  identical  2.5  percent  and  the 
business  cycle  was  about  at  its  peak;  1984  was  selected  to 
provide  a  view  of  recent  youth  unemployment. 

aNo  data  for  persons  of  Hispanic  origin  are  available  for 
1957  or  1964. 


SOURCE:  Data  from  U.S.  Department  of  Labor  (1982,  1985b). 
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males,  but  between  1957  and  1984  this  ratio  approached  parity;  for  20- 
to  24-year-old  white  females,  the  ratio  of  unemployment  rates  was  0.7 
in  1957  and  0.9  in  1984.  (Although  comparable  historical  data  are  not 
available  for  Hispanic  youths,  the  available  data  indicate  that 
Hispanic  males  aged  20-24  were  1.2  times  as  likely  as  white  males  to  be 
unemployed  in  1984,  and  Hispanic  females  were  1.3  times  as  likely  to  be 
unemployed  as  white  males.) 

These  continuing  trends  in  the  relative  unemployment  rates  of  young 
Americans  were  a  primary  motivation  for  the  launching  in  the  late  1970s 
of  federally  funded  programs  designed  to  provide  employment  and  training 
services  to  disadvantaged  youths.  Yet,  as  the  last  column  of  Table 
2.1a  indicates,  the  gap  between  white  and  nonwhite  unemployment  rates 
has  persisted;  in  1984  unemployment  among  white  youths  aged  20-24  was 
9.8  percent  for  males  and  8.8  percent  for  females;  for  nonwhite  youths 
the  rates  were  24.5  and  23.5  percent,  respectively. 

While  the  unemployment  rates  and  ratios  shown  in  Tables  2.1a  and 
2.1b  demonstrate  that  young  people 9 s  problems  have  been  increasing,  the 
unemployment  rate  can  sometimes  be  a  misleading  indicator,  particularly 
when  applied  to  the  youngest  segment  of  the  labor  force  (Hahn  and 
Lerman,  1983; 2) .  To  be  counted  as  unemployed  a  person  must  indicate  in 
answer  to  a  survey  question  that  (1)  she  or  he  is  not  currently  employed 
and  (2)  she  or  he  is  currently  looking  for  work.  People  who  are  not 
working  and  who  say  they  are  not  actively  looking  for  work  are  counted 
as  "out  of  the  labor  force"  rather  than  unemployed.  The  unemployment 
rate  is  calculated  by  dividing  the  number  of  people  who  are  unemployed 
by  the  number  of  people  in  the  labor  force  (defined  as  the  sum  of  the 
employed  [E]  and  unemployed  [U] ) ; 

unemployment  rate  =  U/(U  +  E) 

It  can  be  seen  that  the  unemployment  rate  can  rise  even  though  the 
number  of  employed  (E)  stays  constant.  And,  given  the  way  in  which  one 
is  defined  as  being  "in  the  labor  force,"  it  is  not  necessary  that 
there  be  any  change  in  the  number  of  people  who  are  not  working.  The 
unemployment  rate  may  rise  simply  because  more  people  begin  looking  for 
work  (or  at  least  say  they  are  looking  for  work) ,  thereby  increasing 
the  size  of  the  labor  force.  [See  Bailar  and  Roth we 11  (1984)  and 
National  Commission  on  Employment  and  Unemployment  Statistics  (1979) 
for  discussions  of  this  and  other  aspects  of  unemployment  measurements.] 

The  unemployment  rate  is  particularly  ambiguous  as  an  indicator  of 
employment  problems  in  the  youth  population  because  it  becomes  entangled 
with  school  attendance.  When  young  people  say  that  they  are  looking 
for  work  even  though  they  are  also  enrolled  in  school,  they  are  none¬ 
theless  counted  as  unemployed.  This  method  of  counting  raises  serious 
questions  of  interpretation  since  full-time  students,  it  can  be  argued, 
already  have  a  full-time  though  unpaid  occupation,  attending  school. 

This  component  of  youth  unemployment  statistics  is  not  insubstantial; 
for  example,  almost  half  of  the  1978  teenage  unemployment  shown  in 
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Group 


Year 

1957 


1964 


1978 


198 


Adult  white  males 

35-44  years  old  95.6 

All  youths 

16-19  years  old  43.9 

20-24  years  old  59.5 

White  males 

16-19  years  old  52.4 

20-24  years  old  80.5 

Nonwhite  males 

16-19  years  old  48.0 

20-24  years  old  78.2 

White  females 

16-19  years  old  38.3 

20-24  years  old  43.4 

Nonwhite  females 

16-19  years  old  26.5 

20-24  years  old  40.9 


95.1 

93.9 

91 

37.3 

48.5 

43 

60.9 

69.6 

68 

45.0 

56.3 

49 

79.3 

76.0 

78 

37.8 

29.8 

25 

78.1 

61.1 

58 

32.2 

48.7 

47 

45.3 

60.6 

66 

21.8 

23.5 

21 

43.7 

45.4 

46 

NOTE:  The  years  1957 ,  1964 ,  and  1978  were  selected  because 
in  each  of  these  years  the  unemployment  rate  for  white 
males  aged  35-44  was  an  identical  2.5  percent  and  the 
business  cycle  was  about  at  its  peak.  In  1984  the  rate  of 
unemployment  among  white  males  aged  35—44  was  4.6  percent. 


SOURCES:  Data  from  U.S.  Department  of  Labor  (1979,  1980a, 
1985b);  Bureau  of  Labor  Statistics  (1983). 
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TABLE  2.2b  Ratio  of  Civilian  Employment-to-Population  Rates  for 
Young  White  Males  to  Other  Young  Groups 


Year 

Group 

1957 

1964 

1978 

1984 

White  males 

16-19  years  old 

1.0 

1.0 

1.0 

1.0 

20-24  years  old 

1.0 

1.0 

1.0 

1.0 

Nonwhite  males 

16-19  years  old 

.92 

.84 

.53 

.51 

20-24  years  old 

.97 

.98 

.80 

.75 

White  females 

16-19  years  old 

.73 

.72 

.87 

.96 

20-24  years  old 

.54 

.57 

.80 

.85 

Nonwhite  females 

16-19  years  old 

.51 

. 

03 

.42 

.44 

20-24  years  old 

.51 

.55 

.60 

.59 

NOTE:  The  years  1957 ,  1964,  and  1978  were  selected  because  in 
each  of  these  years  the  unemployment  rate  for  white  males  aged 
35-44  was  an  identical  2.5  percent  and  the  business  cycle  was 
about  at  its  peak.  In  1984  the  rate  of  unemployment  among  white 
males  aged  35-44  was  4.6  percent. 

SOURCES:  Data  from  U.S.  Department  of  Labor  (1979,  1980a,  1985b); 
Bureau  of  Labor  Statistics  (1983)  . 


the  older  youth  group,  aged  20-24,  than  for  the  younger  group,  and  the 
decline  from  1978  to  1984  was  steeper  for  the  younger  group. 

At  a  more  detailed  level,  the  trends  for  various  demographic  groups 
are  not  homogeneous.  For  example,  there  was  a  large  increase  in  the 
employment  rates  of  white  women  aged  20-24  (from  43  percent  in  1957  to 
66  percent  in  1984) ,  but  there  was  also  a  substantial  decline  in  the 
employment  rates  for  nonwhite  men  of  the  same  age  group  (from  78.2  to 
58.3  percent).  Table  2.2b  presents  the  ratios  of  the  employment  rates 
of  each  group  to  the  employment  rate  for  white  males.  From  1957  to 
1984  this  ratio  declined  markedly  for  nonwhite  males.  For  nonwhite 
females  the  ratios  declined  for  the  younger  group,  while  they  increased 
somewhat  for  20-  to  24-year-olds.  Nonetheless,  in  all  years  for  both 
age  groups,  the  likelihood  that  nonwhite  females  would  be  employed  was 
less  than  0.6  times  the  likelihood  that  white  males  would  be  employed. 
For  white  females,  the  ratios  showed  steady  increases  from  1964  to 
1984,  with  the  ratio  for  the  most  recent  year  approaching  parity  for 
16-  to  19-year-olds;  however,  it  was  somewhat  lower  (0.85)  for  20-  to 
24-year -olds. 


.  ,  •  ^ff^ance  with  trends  m  employment.  in 

confusing  trends  m  school  attendance  wxuj  ^  rT,  . , 

the  present  case,  this  is  a  particularly  worrisome  possibility  While 

the  employment  rate  for  nonwhite  youths  has  declined  over  the  last  3 

decades  (as  shown  in  Table  2.2a),  the  school  enrollment  rate  for 

nonwhite  youths  has  increased  during  these  same  decades.  The  rate  of 

high  school  completion  among  black  men  and  women  aged  25-29  rose  from 

47.7  percent  in  1960  to  65.4  percent  in  1970  and  to  79.4  percent  m 


1983.  ^  n 

The  employment  patterns  of  youths  who  are  enrolled  in  school  are, 

of  course,  considerably  different  from  those  who  are  out  of  school. 
Table  2.3  provides  a  breakdown  by  school  enrollment  of  the  employment 
rates  for  1964,  1978,  and  1981  for  all  youths  aged  16-24. 2  As  one 
would  expect,  in-school  youths  are  less  likely  to  be  employed  than 
out-of-school  youths.  However,  there  are  significant  differences  in 
these  rates  over  time  for  different  groups.  For  white  males,  the 
employment  rates  increased  for  in-school  youths  from  34.0  percent  in 
1964  to  43.4  percent  in  1981,  while  the  rate  for  out-of -school  youths 
was  stable  at  approximately  87  percent  between  1964  and  1978  and  then 
declined  slightly  during  the  economic  downturn  in  1981.  In  contrast, 
the  employment  rates  of  black  males  have  shown  a  marked  decline  for 
both  in-school  and  out-of-school  youths:  the  rate  for  those  out  of 
school  was  80.5  percent  in  1964,  67.8  in  1978,  and  57.8  in  1981;  the 
rate  for  those  in  school  dropped  from  30  percent  in  1964  to  20  percent 
in  1978  and  was  still  at  20  percent  in  1981. 3 


1  Ideally,  one  would  like  to  examine  trends  in  employment  status 
broken  down  by  school  enrollment,  race,  sex,  age,  presence  of 
dependents,  and  living  arrangements.  Unfortunately,  tabulations  of 
employment  statistics  (e.g.,  the  Employment  and  Earnings  series  and  th 
Handbook  of  Labor  Statistics)  do  not  provide  the  appropriate  detail. 
Indeed,  even  with  the  60,000+  sample  size  of  the  Current  Population 
Survey,  we  suspect  it  would  be  difficult  to  obtain  reliable  estimates 
or  all  the  cells  of  such  a  cross-tabulation.  Consequently  we  use  the 
strategy  of  examining  the  employment  status  of  older,  out-of-school 
youths  as  a  crude  substitute. 

19M  1978  W6re  seleoted  to  Provide  consistency  with 

,,  ® ,^bleVn  thlS  °*laptBr •  Appropriate  data  were  not  published  in 
57  (or  earlier  years).  Ho  data  are  currently  available  for  1984; 
consequently,  we  have  used  the  most  recent  published  statistics,  for 

WackhiouttaSCr!thi0n  Tael6S  2'3  and  2’4  We  used  statistics  for 
Mack  youths  rather  than  for  nonwhite  youths.  This  reflects  the 

categorization  used  in  the  published  statistics.  refleots  the 

by  black'and^hite'and  P°^latl° 

nonwhite  statistics  can  be  computed,,  I^r^f  y^flt^  'fLi 
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TABLE  2.3  Employment-to-Population  Rates  for  In-School  and 
Out-of-School  Youths  Aged  16-24  by  Sex  and  Race;  1964-1981 


Employment-to-Population  Rate 


Group 

Out-of- 
School  Youths 

In-School  Youths 

White  males 

1964 

86.7 

34.0 

1978 

86.9 

46.9 

1981 

81.1 

43.4 

Black  males 

1964 

80.5 

30.0 

1978 

67.8 

20.3 

1981 

57.8 

20.1 

White  females 

1964 

47.3 

23.3 

1978 

66.2 

45.7 

1981 

68.3 

43.0 

Black  females 

1964 

48.0 

15.4 

1978 

46.9 

20.6 

1981 

43.0 

17.2 

SOURCE;  Bureau  of  Labor  Statistics  (1982:Table  C-42) . 


Comparing  the  data  for  young  males,  one  finds  that  in  1964  the 
employment  rates  of  both  in-school  and  out-of-school  black  males  were 
roughly  90  percent  as  large  as  those  of  white  males.  However,  by  1981 
this  gap  had  widened  enormously;  in-school  black  males  were  less  than 
50  percent  as  likely  to  be  employed  as  white  males,  and  out-of-school 
black  males  were  only  71  percent  as  likely  to  be  employed  as  white 
males. 

For  young  females,  the  data  for  blacks  and  whites  also  show  very 
different  trends.  Both  in-school  and  out-of-school  white  females 
registered  roughly  a  20  percentage  point  increase  in  their  employment- 


the  case  that  only  statistics  for  whites  and  nonwhites  were  published. 
It  is  thus  impossible  to  produce  long  time  series  (e.g.,  1950-1980) 
that  describe  the  black  youth  population.  Nonetheless,  the  nonwhite 
statistics,  while  less  than  ideal,  do  capture  much  of  what  is  important 
since  blacks  constitute  the  vast  majority  of  the  nonwhites  in  the 
United  States.  In  1980  the  nonwhite  population  included;  26.5  million 
blacks;  3.5  million  Asians  and  Pacific  Islanders;  1.4  million  American 
Indians,  Eskimos,  and  Aleuts;  and  6.8  million  persons  whose  race  was 
classified  as  "other." 


Aae 


Group 

16-17 

18-19 

20-24 

White  males 

1964 

65.6 

80.9 

90.0 

1978 

52.2 

85.0 

89.5 

1981 

54.3 

75.3 

84.0 

Black  males 

1964 

43.8 

73.4 

86.6 

1978 

19.4 

44.7 

59.4 

1981 

22.2 

39.8 

62.8 

White  females 

1964 

30.7 

51.9 

47.3 

1978 

47.3 

64.7 

67.7 

1981 

34.1 

62.4 

68.3 

Black  females 

1964 

35.9 

45.1 

50.2 

1978 

21.4 

46.7 

63.4 

1981 

5.5 

29.5 

48.5 

SOURCE:  Bureau  of  Labor  Statistics  (1982:Table  C-42)  . 


to-population  rates  between  1964  and  1981.  For  the  in-school  grou 
their  employment  rate  in  1981  was  virtually  identical  to  that  of  w 
males.  For  out-of-school  females,  their  employment  rates  were  con 
sistently  below  those  of  young  white  males,  although  they  increase 
significantly  between  1964  and  the  later  two  years.  For  black  fern 
there  was  a  slight  upward  trend  in  employment  while  in  school  duri 
the  period  1964  to  1981;  for  the  out-of-school  group,  the  rate  dec 
slightly  over  the  period,  from  48  percent  in  1964  to  43  percent  in 
Table  2.4  disaggregates  the  employment-to-population  rates  of 
out-of-school  youths  by  age.  This  breakdown  shows  that  the  aggreg 
results  hold  for  all  age  groups  of  out-of-school  youths,  including 
oldest.  Many  researchers  argue  that  unemployment  among  these  olde 
out-of -school  youths  is  of  particular  concern  because  they  are  mor 
likely  to  have  dependents  to  support  and  to  be  living  outside  thei 
parental  home.  This  group  shows  the  familiar  pattern  of  rather  hi 
employment  rates  among  white  males  (90.0  percent  in  1964,  84.0  per 
in  1981)  and  consistently  lower  rates  for  blacks  and  females.  For 
out-of-school  black  males  aged  20-24,  the  employment-to-population 
in  1964  (86.6  percent)  approaches  that  of  white  males,  but  the  rat 
declines  by  over  20  percentage  points  in  the  following  decade.  Wh 
females  in  this  age  group  show  increasing  rates  of  employment,  but 
are  still  less  likely  to  be  employed  than  white  males  (47.3  percen 


TABLE  2.5a  Civilian  Labor  Force  Participation  Rates  by 
Age,  Race,  and  Sex  (in  percentages) 


Year 

Group 

1957 

1964 

1978 

1984 

All  youths 

16-17  years  old 

40.2 

35.1 

48.6 

42.4 

18-19  years  old 

60.4 

57.2 

67.3 

64.9 

20-24  years  old 

64.0 

66.3 

76.8 

77.6 

White  males 

16-17  years  old 

49.6 

43.5 

55.3 

47.0 

18-19  years  old 

71.6 

66.6 

75.3 

70.8 

20-24  years  old 

86.7 

85.7 

87.3 

86.5 

Nonwhite  males 

16-17  years  old 

47.5 

37.3 

33.2 

27.0 

18-19  years  old 

72.0 

67.2 

58.9 

55.4 

20-24  years  old 

89.6 

89.4 

77.5 

77.2 

White  females 

16-17  years  old 

32.1 

28.5 

48.8 

44.8 

18-19  years  old 

52.6 

49.6 

64.6 

65.2 

20-24  years  old 

45.8 

48.8 

69.3 

72.5 

Nonwhite  females 

16-17  years  old 

24.1 

19.5 

27.7 

24.7 

18-19  years  old 

42.8 

46.5 

48.4 

45.8 

20-24  years  old 

46.6 

53.6 

62.6 

60.5 

NOTE:  The  years  1957, 

1964,  and 

1978  were 

selected 

because 

in  each  of  these  years  the  unemployment  rate  for  white 
males  aged  35-44  was  an  identical  2.5  percent  and  the 
business  cycle  was  at  about  its  peak.  In  1984  the  rate  of 
unemployment  among  white  males  aged  35-44  was  4.6  percent. 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1982,  1985b) . 


white  females  were  employed  in  1964  and  68.3  percent  in  1981).  For 
black  females  aged  20-24,  the  employment  rate  rises  from  50.2  percent 
in  1964  to  63.4  percent  in  1978  and  then  declines  to  48.5  percent  in 
1981. 


Labor  Force  Participation  Rates  and  Summary  of  Employment  Data 

Tables  2.5a  and  2.5b  provide  complementary  information  on  the 
aggregate  civilian  labor  force  participation  rates  of  youths  by  age, 
sex,  and  race.  (The  civilian  labor  force  participation  rate  is  the 
ratio  of  employed  and  unemployed  people  to  the  total  nonmilitary 


Group 


White  males 

16-17  years  old 
18-19  years  old 
20-24  years  old 
Nonwhite  males 
16-17  years  old 
18-19  years  old 
20-24  years  old 
White  females 
16-17  years  old 
18-19  years  old 
20-24  years  old 
Nonwhite  females 
16-17  years  old 
18-19  years  old 
20-24  years  old 


1.0 

1.0 

1.0 


1.0 

1.0 

1.0 


.96 

1.00 

1.03 


.86 

1.00 

1.04 


.65 

.73 

.53 


.66 

>74 

57 


.43 

.60 

.54 


.45 

.70 

.63 


1.0 

1.0 

1.0 


.60 

.78 

.89 


.88 

.86 

.79 


.50 

.64 

.72 


1. 

1. 

1. 


.1 


.S 

.9 

.8 


.5 

.6 

.7 


Kch  *  IZ:  bill's  IIT'ZZ978  Were  becau, 

"ales  aged  35-44  was  an  identLTlT^^  f°r  white 

business  cycle  was  at  about  its  Peroent  and  the 

unemployment  among  white  males  aged  35-^4  01 

yea  jo  44  was  4.6  percent. 

SOURCF!  *  _ 


Data  from  U.S.  Department  of  Labor  <1982,  l985b) 


1  as  noted  above  i  u 

who  are  unemployed  and  not 'look  ina^o  statistics  exclude 
rates  m  Tables  2.1a  through  ?  worko)  A  comparison  of 
youth  unemployment  is^^/^,™1*-  ^  and  2‘5b  -9' 
for  males  and  females  and  whites  a J  ^  differe"t  underlyi, 
useful  to  discuss  each  group  separatelT  POr  reas< 


White  Males 


Sriod!3^^"^3^3  f°t  white  males  fluctua. 
16-  to  17-year-olds)  but  declinLi  ?  "  1957  and  1978  (Particular 
upward  movement  in  the  employmentt™,*!  Z  1984 '  There  was  a 

P  pulation  rate  between  195 


1978  for  youths  aged  16-19,  but  the  employment  rate  for  youths  aged 
20-24  declined  from  80  percent  to  76  percent  in  1978  then  rose  to  78 
percent  in  1984.  The  unemployment  rate  for  the  younger  group  has 
increased  because  the  labor  force  participation  rate  of  the  group  aged 
16-17  has  increased  by  more  than  the  employment-to-population  rate. 


Nonwhite  Males 

For  nonwhite  males  the  story  is  stark  and  consistent.  During  the 
period  from  1957  to  1984,  the  labor  force  participation  rates  of  young 
nonwhite  males  of  every  age  group  declined  considerably,  and  their 
employment-to-population  rates  also  dropped  markedly.  The  proportion 
of  those  aged  16-19  who  were  employed  declined  from  48  to  25.2  percent; 
for  those  aged  20-24  it  declined  from  78.2  to  58.3  percent.  Thus  the 
large  increases  shown  in  Table  2.1a  for  the  unemployment  rates  of 
nonwhite  males  understate  the  labor  market  difficulties  faced  by  this 
group:  had  their  labor  force  participation  rates  not  declined  from 
1957  to  1984,  their  unemployment  rates  would  have  been  even  higher  than 
shown  in  Table  2.1a. 


White  Females 

White  females  sharply  increased  their  labor  force  participation 
from  1957  to  1984.  For  20-  to  24-year-olds,  the  rate  of  participation 
increased  from  45.8  to  72.5  percent,  and  the  gap  between  white  male  and 
female  levels  of  participation  decreased  substantially.  The  employment- 
to-population  rates  for  this  group  also  increased  during  this  period, 
from  43.4  to  66.1  percent  for  those  aged  20-24,  and  as  a  result  their 
unemployment  rate  increased.  The  overall  picture  for  white  females  is 
one  of  an  improving  employment  situation,  but  one  that  has  not  improved 
rapidly  enough  to  keep  pace  with  their  increasing  desire  (and  need)  to 
participate  in  the  labor  force. 


Nonwhite  Females 

The  labor  force  participation  rates  of  nonwhite  females  increased 
less  rapidly  than  did  the  rates  for  white  females,  although  the  increase 
for  20-  to  24-year-olds  is  still  quite  sharp,  from  46.6  percent  in  1957 
to  60.5  percent  in  1984.  During  the  entire  period,  nonwhite  females 
have  had  lower  labor  force  participation  rates  than  all  other  subgroups. 
The  employment-to-population  rate  for  nonwhite  females  declined  for 
those  aged  16-19  and  increased  for  those  aged  20-24.  For  the  entire 
period  nonwhite  females  had  lower  employment-to-population  rates  than 
all  other  subgroups.  Thus,  despite  some  signs  of  improvement  in 
absolute  levels  for  those  aged  20-24,  the  employment  rates  reveal  the 
very  serious  situation  of  nonwhite  females  in  comparison  with  other 
groups  of  the  youth  population. 


Hispanic  Youths 


There  are  no  adequate  historical  data  to  perforin  similar  analys 
for  Hispanic  youths,  and  so  we  are  unable  to  assess  the  dynamics  tl 
may  account  for  the  Hispanic  unemployment  rates  shown  in  Table  2.1; 
Those  rates  are  higher  than  those  for  white  youths  but  lower  than  1 
for  nonwhite  youths:  as  shown,  for  males  aged  20-24,  the  unemployr 
rates  in  1984  were  9.8  percent  for  white  males,  12.1  percent  for 
Hispanic  males,  and  24.5  percent  for  black  males. 


Inactivity  Rates 

The  above  analyses  suggest  that  when  one  looks  beyond  the  unemj 
ment  rate,  a  more  complex  picture  of  the  nature  of  the  youth  unemp] 
ment  problem  emerges.  The  most  striking  features  of  this  picture  c 
the  changing  dynamics  of  female  employment  (particularly  among  whit 
and  the  stark  contrast  between  the  employment  statistics  for  young 
black  men  and  women  and  those  faced  by  other  groups.  These  differe 
can  be  seen  even  more  clearly  in  " inactivity  rates,”  the  numbers  oi 
youths  who  are  neither  in  school,  nor  in  the  military,  nor  employee 
relative  to  their  population.  Table  2.6a  presents  inactivity  rates 
several  demographic  groups  for  the  years  1964,  1978,  and  1983.  Foi 
almost  every  group  the  inactivity  rates  were  lower  in  1978  than  the 
were  in  1964;  the  major  exception  is  for  nonwhite  males  aged  20-24/ 
whose  inactivity  rate  during  this  period  climbed  from  10.5  to  15.9 
percent. 

It  should  also  be  noted  that  the  inactivity  rates  for  both  whit 
and  nonwhite  women  aged  20-24  remained  strikingly  higher  than  those 
white  and  nonwhite  males.  As  shown  in  Table  2.6a,  the  inactivity  r 
for  nonwhite  females  in  1978  were  28.0  percent  for  18-  to  19-year-c 
and  33.5  percent  for  20-  to  24-year -olds. 

In  1983  the  inactivity  rates  of  almost  all  groups  were  higher  t 
in  1978.  This  reflects  the  depressed  state  of  the  national  economy 
1983,  which  is  also  reflected  in  the  rise  in  the  rate  of  unemployme 
for  35-  to  44-year-old  white  males  from  2.5  percent  in  1978  to  5.2 
percent  in  October  1983.  During  this  period  the  inactivity  rates  i 
nonwhite  females  took  especially  large  leaps:  in  1983  more  than  4( 
percent  of  nonwhite  women  aged  18-24  were  out  of  work  and  out  of  sc 

While  inactivity  rates  for  all  groups  rose  in  1983,  because 
inactivity  rates  for  white  males  rose  faster  than  did  those  of  othc 
groups,  the  situation  of  nonwhites  of  both  sexes  and  white  females 
showed  some  improvement  relative  to  that  of  white  males;  see  Table 
2.6b.  For  example,  among  20-  to  24-year-olds,  the  inactivity  rates 
relative  to  white  males  declined  from  2.69  to  2.33  for  nonwhite  ma] 
from  4.08  to  2.16  for  white  females,  and  from  5.68  to  3.93  for  nonv 
females.  However,  the  inactivity  rates  for  both  male  and  female 
nonwhites  and  for  white  females  are  still  higher  than  those  for  wh: 
males.  Over  the  entire  period  1964  to  1983,  the  lowest  inactivity 
rates  for  every  age  group  are  those  for  white  males. 


TABLE  2.6a  Inactivity  Rates  for  Youths  by  Race  and  Sex 


Year 

Group 

1964 

1978 

1983a 

White  males 

16-17  years  old 

3.3 

3.6 

4.5 

18-19  years  old 

8.0 

4.7 

13.1 

20-24  years  old 

6.1 

5.9 

11.6 

Nonwhite  males 

16-17  years  old 

8.4 

3.7 

4.7 

18-19  years  old 

14.6 

13.2 

29.3 

20-24  years  old 

10.5 

15.9 

27.0 

White  females 

16-17  years  old 

9.6 

4.6 

5.7 

(5.7) 

18-19  years  old 

31.9 

13.2 

18.5 

(18.6) 

20-24  years  old 

46.8 

24.1 

25.1 

(25.3) 

Nonwhite  females 

16-17  years  old 

11.5 

6 . 4 

5.8 

(5.9) 

18-19  years  old 

36.2 

28.0 

42.2 

(42.5) 

20-24  years  old 

45.7 

33.5 

45.6 

(45.6) 

NOTE:  Inactivity  rates  are  the  percentage  of  the 

population  that  is  neither  employed,  serving  in  the 
military,  nor  enrolled  in  school.  The  years  1964  and 
1978  were  selected  because  the  unemployment  rate  for 
white  males  aged  35-44  was  an  identical  2.5  percent  and 
the  business  cycle  was  about  at  its  peak.  October  1983 
is  the  most  recent  date  for  which  comparable  rates  can 
be  computed.  In  October  1983  the  rate  of  unemployment 
among  white  males  aged  35-44  was  5.2  percent  (not 
seasonally  adjusted) . 

aFor  1983,  figures  in  parentheses  are  female 
inactivity  rates  calculated  to  take  account  of  military 
service  by  females. 

SOURCES:  Data  for  1964  and  1978  from  Congressional 
Budget  Office  (1982) ;  data  for  1983  computed  from  Bureau 
of  Labor  Statistics  (1984)  and  unpublished  tabulation  of 
military  enrollment  by  age,  race,  and  sex.  (Data  for 
1984  are  not  currently  available.) 


TABLE  2.6b  Ratio  of  Inactivity  Rates  for  Other  Groups 
to  Those  for  White  Males 


Year 

Group 

1964 

1978 

198  3a 

White  males 


16-17  years  old 

1.0 

1.0 

1.0 

18-19  years  old 

1.0 

1.0 

1.0 

20-24  years  old 

1.0 

1.0 

1.0 

Nonwhite  males 

16-17  years  old 

2.55 

1.03 

1.04 

18-19  years  old 

1.82 

2.80 

2.24 

20-24  years  old 

1.72 

2.69 

2.33 

White  females 

16-17  years  old 

2.91 

1.28 

1.27 

(1.27! 

18-19  years  old 

3.99 

2.81 

1.41 

(1.42! 

20-24  years  old 

7.67 

4.08 

2.16 

(2.18] 

Nonwhite  females 

16-17  years  old 

3.48 

1.78 

1.29 

(1.31] 

18-19  years  old 

4.53 

5.96 

3.22 

(3.24] 

20-24  years  old 

7.49 

5.68 

3.93 

(3.93: 

NOTE:  Inactivity  rates  are  the  percentage  of  the 
population  that  is  neither  employed,  serving  in  the 
military,  nor  enrolled  in  school.  The  years  1964  and 
1978  were  selected  because  the  unemployment  rate  for 
white  males  aged  35-44  was  an  identical  2.5  percent  and 
the  business  cycle  was  about  at  its  peak.  October  1983 
is  the  most  recent  date  for  which  comparable  rates  can 
be  computed.  In  October  1983  the  rate  of  unemployment 
among  white  males  aged  35-44  was  5.2  percent  (not 
seasonally  adjusted) . 

aFor  1983,  figures  in  parentheses  are  female 
inactivity  rates  calculated  to  take  account  of  military 
service  by  females. 

SOURCES:  Data  for  1964  and  1978  from  Congressional 
Budget  Office  (1982) ;  data  for  1983  computed  from  Bureau 
of  Labor  Statistics  (1984)  and  unpublished  tabulation  of 
military  enrollment  by  age,  race,  and  sex.  (Data  for 
1984  are  not  currently  available.) 


As  the  ratios  presented  in  Table  2.6b  make  clear ,  the  disparities 
in  inactivity  rates  are  often  quite  large.  For  females ,  even  though 
the  disparities  in  inactivity  declined  between  1964  and  1983,  inactivity 
rates  for  those  aged  20-24  were  still  2.16  (for  whites)  and  3.93  (for 
nonwhites)  times  as  large  as  those  of  white  males.  (It  is  unfortunate 
that  we  are  unable  to  disaggregate  this  result  to  determine  the  portion 
of  female  "inactivity"  that  represents  women  who  are  at  home  with  young 
children.  Because  some  of  this  female  "inactivity"  represents  child¬ 
bearing,  readers  are  advised  to  interpret  the  inactivity  rates  in 
conjunction  with  the  unemployment  rates  shown  in  Table  2.1.)  For 
nonwhite  males,  the  trends  across  time  show  increasing  disparity  for 
youths  aged  18-24.  While  the  ratio  of  inactivity  rates  was  1.82  (for 
those  18-19)  and  1.72  (for  those  20-24)  in  1964,  it  had  increased  to 
2.24  and  2.33  by  1983,  and  the  disparity  was  even  higher  during  1978,  a 
time  of  increased  economic  activity.  The  sole  exception  to  this 
disturbing  picture  is  found  among  the  youngest  group  of  nonwhite  males. 
Their  ratio  declined  from  2.55  in  1964  to  approximate  parity  in  1978  (a 
ratio  of  1.03)  and  remained  at  that  level  in  1983  (a  ratio  of  1.04). 

This  improvement  relative  to  white  males  is  attributable  to  increased 
levels  of  school  enrollment  and  roughly  constant  rates  of  military 
enlistment  for  young  black  males.  A  similar  trend  can  be  observed  for 
16-  to  17-year-old  females,  although  in  1983  both  white  and  nonwhite 
females  were  still  approximately  1.3  times  as  likely  to  be  out  of 
school  and  out  of  work  as  white  males. 


Entry,  Turnover,  and  Unemployment 

Another  way  to  understand  the  nature  of  the  youth  employment  problem 
is  to  study  the  nature  of  the  events  that  lead  to  unemployment.  An 
analysis  by  Freeman  and  Medoff  (1982)  provides  some  insight  into  the 
processes  that  lead  to  youth  unemployment  (see  Table  2.7)  .  The  salient 
feature  of  Table  2.7  is  the  sizable  proportion  of  young  people  whose 
unemployment  is  associated  with  entry  into  the  labor  force — either  for 
the  first  time,  as  new  entrants,  or  reentry  after  a  period  out  of  the 
labor  force.  The  high  proportion  of  new  entrants  among  youths  is  not 
surprising.  The  high  proportion  of  reentrants  reflects  the  fact  that 
teenagers  tend  to  drop  out  of  the  labor  force  after  a  period  of  unem¬ 
ployment.  As  youths  get  older,  however,  their  unemployment  is  less 
likely  to  be  due  to  entry  or  reentry  into  the  labor  market. 

Thus,  in  1978,  for  those  aged  16-17,  entrants  into  the  labor  market 
accounted  for  the  vast  majority  of  the  unemployed — 39.8  percentage 
points  of  the  44.0  percent  unemployment  rate  of  blacks  and  11.0 
percentage  points  of  the  13.8  percent  unemployment  rate  of  whites  in 
1978.  Among  those  aged  18-19  entrants  into  the  labor  market  accounted 
for  30.5  percentage  points  of  the  38.0  percent  unemployment  rate  for 
blacks  and  4.5  percentage  points  of  the  9.0  percent  rate  for  whites. 

By  the  age  of  20-24,  most  of  the  unemployed  youths  have  left  or  lost 
their  jobs:  entrants  into  the  labor  market  account  for  only  7.9 
percentage  points  of  the  18.8  percent  black  unemployment  rate  and  2.3 
percentage  points  of  the  6.6  percent  white  unemployment  rate. 


TABLE  2.7  Direct  Causes  of  Youth  Unemployment,  Males  and  Females: 
1969-1978 


Black 

White 

Age  and  Status 

1969  1975 

1978 

1969  1975 

16-17  years  old 

Total  unemployment 

rate 

24.6 

42.4 

44.0 

10.7 

17.7 

losers 

2.7 

5.6 

3.4 

1.4 

3.3 

leavers 

2.4 

1.8 

0.8 

1.0 

1.4 

total  entrants 

19.6 

35.1 

39.8 

8.2 

13.0 

reentrants 

7.7 

19.5 

11.9 

3.5 

5.0 

new  entrants 

11.9 

15.6 

28.0 

4.7 

8.0 

18-19  years  old 

Total  unemployment 

rate 

18.5 

36.7 

38.0 

5.7 

15.9 

losers 

5.4 

13.1 

4.8 

1.9 

7.2 

leavers 

4.5 

0.7 

2.7 

0.7 

1.3 

total  entrants 

8.6 

22.9 

30.5 

3.1 

7.4 

reentrants 

8.1 

14.1 

17.8 

2.5 

4.8 

new  entrants 

0.5a 

8.8 

12.7 

0.6 

2.6 

20-24  years  old 

Total  unemployment 

rate 

7.1 

28.3 

18.8 

4.4 

13.6 

losers 

2.5 

18.0 

8.7 

1.6 

8.7 

leavers 

2.7 

1.7 

2.2 

1.0 

1.0 

total  entrants 

2.0 

8.7 

7.9 

1.7 

4.0 

reentrants 

1.5 

5.8 

5.1 

1.5 

3.6 

new  entrants 

0.5 

2.9 

2.9 

0.2 

0.4 

NOTE:  Regularly  published  tabulations  (e.g..  Employment  and  Earning; 
not  provide  age  breakdowns  for  16-  to  17-  and  18-  to  19-year-olds.  ' 
there  are  no  readily  accessible  tabulations  for  years  after  1978. 

aThis  rate  is  reported  as  .05  in  Freeman  and  Medoff  (1982).  This 
appears  to  be  a  typographical  error;  it  has  been  corrected  to  0.5,  wl 
would  be  consistent  with  the  published  rates  for  total  entrants  and 
reentrants. 

SOURCE:  Freeman  and  Medoff  (1982) . 


A  second  important  cause  of  unemployment  as  shown  in  Table  2.7  i; 
the  high  percentage  of  job  losers;  for  all  but  one  group  (blacks  age< 
20-24  in  1969),  job  losers  exceed  job  leavers.  In  contrast  to  the 
usual  view  that  youths  have  high  unemployment  rates  because  they  quii 
jobs  more  often  than  adults,  these  data  indicate  that  their  problems 
arise  primarily  because  they  lose  jobs  or  tend  to  find  jobs  for  whicl 
the  probability  of  firing  or  layoffs  is  higher. 


TABLE  2.8  Ratios  of  the  Median  Usual  Weekly  Earnings  of  Out-of-School 
Males  to  Earnings  of  Male  Workers  Aged  25  and  Older,  by  Race;  1967-77 


Age 

Earnings  of  Full-Time 
Young  White  Men/ 
Earnings  of  Full-Time 
White  Men,  Age  25+ 

Change 

in 

Earnings 

Ratios 

Earnings  of  Full-Time 
Young  Nonwhite  Men/ 
Earnings  of  Full-Time 
White  Men,  age  25+ 

Change 

in 

Earnings 

Ratios 

1967 

1977 

1967-77 

1967  1977 

1967-77 

16 

.38 

.34 

-.04 

.33  .32 

-.01 

17 

.49 

.39 

-.10 

.39  .32 

-.07 

18 

.54 

.49 

-.05 

.44  .44 

.00 

19 

.61 

.52 

-.09 

.42  .43 

-.01 

20 

.66 

.58 

-.08 

.63  .52 

-.11 

21 

.73 

.61 

-.12 

.57  .50 

-.07 

22 

.79 

.63 

-.16 

.59  .54 

-.05 

23 

.81 

.71 

-.13 

.59  .54 

-.05 

24 

.87 

.75 

-.12 

.60  .63 

-.03 

SOURCE:  Data  from  Freeman  and  Medoff  (1982:Table  3.9). 

In  an  interesting  analysis  of  the  black/white  differential  in 
unemployment.  Freeman  and  Medoff  (1982)  demonstrate  that  much  of  the 
gap  is  due  to  the  longer  time  it  takes  young  black  men  and  women  to 
find  a  job  on  entry  into  the  labor  force.  In  addition,  among  youths 
aged  20-24,  the  higher  black  unemployment  rate  is  partly  due  to  a 
higher  job  loss  rate  than  for  whites.  Black  youths  appear  to  have  both 
a  harder  time  finding  a  first  job  and  a  greater  likelihood  of  losing  a 
job  than  whites  (Freeman  and  Medoff,  1982)  . 

Entry  and  job  turnover  figures  cannot,  however,  be  used  to  discount 
the  unemployment  problem  as  a  whole,  since  a  subset  of  youths  are 
unemployed  for  long  periods  of  time  and  bear  a  disproportionate  share 
of  the  burden.  Feldstein  and  Ellwood  (1982),  using  1976  Current 
Population  Survey  data  on  out-of-school  teenagers,  estimate  that  8.3 
percent  of  the  youths  were  unemployed  for  more  than  26  weeks  and 
account  for  52  percent  of  total  unemployment  days  among  that  group. 
Lerman  (1980a)  estimates,  using  1977  data,  that  70-80  percent  of  total 
youth  unemployment  (including  that  of  in-school  youths)  was  borne  by 
youths  with  15  or  more  weeks  of  unemployment. 


Wages  and  Earnings 

While  many  employment  problems  can  be  measured  in  terms  of 
nonemployment  of  one  type  or  another,  a  full  picture  of  the  youth 
employment  predicament  also  requires  consideration  of  wages  and 
earnings.  Table  2.8  presents  data  on  the  earnings  of  male  youths  as  a 
percentage  of  earnings  of  white  males  aged  25  and  over.  Two  features 
of  these  data  should  be  noted:  First,  over  the  decade  from  1967  to 
1977,  the  earnings  of  young  men  relative  to  those  of  adult  men  declined. 


Second,  the  extent  of  the  decline  was  greater  for  white  than  nonwhi 
youths  and,  therefore,  the  earnings  of  young  black  men  grew  relativ 
those  of  young  white  men.  Thus,  we  see  both  a  general  deterioration 
earnings  of  young  males  and  a  relative  increase  in  earnings  (actual 
smaller  decrease)  for  young  black  males  compared  with  young  white  m 
Moreover,  when  various  individual  characteristics  are  controlled,  t 
average  wages  for  young  black  males  are  not  significantly  different 
from  those  of  young  white  males. 

The  observed  difference  in  total  earnings  is  due  primarily  to  t 
fact  that  the  probability  of  a  young  black  male  with  a  given  set  of 
characteristics  obtaining  a  job  is  much  lower  than  that  of  a  young 
white  male  with  similar  characteristics  (Freeman,  1980) .  Unfortuna 
there  is  no  comparable  analysis  for  the  earnings  of  young  women,  an 
thus  we  do  not  know  if  a  similar  finding  would  result. 


CAUSES  AND  CONSEQUENCES  OF  YOUTH  EMPLOYMENT  PROBLEMS 

The  previous  section  has  documented  unemployment  rates  and  othe 
measures  of  employment  for  youths  and  differences  among  blacks  and 
whites,  males  and  females,  and  other  groups  for  the  past  2  decades, 
has  also  raised  a  score  of  questions.  What  explains  the  high  unemp 
ment  rate  of  youths  compared  with  adults?  Why  have  rates  of  unempL 
ment  been  rising?  Why  has  the  gap  between  blacks  and  whites  widene 
How  do  these  trends  relate  to  the  relative  decline  in  earnings  for 
young  full-time  workers  and  the  narrowing  gap  in  earnings  between  y 
white  and  black  full-time  workers?  What  is  the  source  of  the  male/ 
female  differences  in  youth  employment  experiences? 

Researchers  typically  discuss  a  number  of  supply  and  demand  fac 
that  might  contribute  to  continuing  high  unemployment  rates  for  you 
(e.g.,  Ellwood  and  Wise,  1983).  On  the  demand  side  the  factors  inc 
poor  macroeconomic  performance;  shifting  geographical  and  industria 
distribution  of  jobs;  minimum  wage  laws  and  other  government  interv 
tions  in  the  labor  market;  discrimination  in  hiring;  and  demand  for 
military  personnel.  On  the  supply  sides'" the  factors  includes  the  b 
boom  bulge  and  other  demographic  factors;  unrealistic  expectations 
youths  and  the  "reservation"  wage;  and  mismatched  jobs  and  educatio 
qualifications.  Each  of  these  factors  is  discussed  in  this  section 
turn,  along  with  recent  empirical  evidence  and  the  nature  of  contin 
disagreements  among  researchers.  At  the  end  of  this  section,  we  al 
consider  other  factors  that  do  not  fit  neatly  into  the  demand  and 
supply  categories. 

At  the  outset  it  should  be  kept  in  mind  that  it  is  not  possible 
discriminate  accurately  among  all  these  causes  given  the  available 
data.  If  time-series  data  are  used,  there  are  too  many  overlapping 
correlated  trends  to  distinguish  among  them:  for  example,  the  baby 
boom  bulge  coincided  with  "stagflation"  and  poor  macroeconomic  per¬ 
formance  in  the  1970s.  it  is  also  very  difficult  to  measure  or  dis 
tinguish  between  the  effects  of  subjective  variables  such  as 
discrimination  on  the  demand  side  or  low  motivation  or  lack  of  gene 
skills  on  the  supply  side. 


Factors  Affecting  the  Demand  for  Labor 
:roeconomic  Conditions 

The  unemployment  rates  of  youths  are  more  sensitive  to  macro- 
>nomic  conditions  than  are  those  of  adults.  Comprehensive  studies  of 
te-series  data  by  the  Congressional  Budget  Office  and  the  Council  of 
>nomic  Advisors  suggest  that  a  1  percent  change  in  the  unemployment 
:e  for  adult  males  is  matched  by  a  1.5  percent  change  for  white 
iths  and  a  2.5  percent  change  for  black  youths  (e.g.,  Congressional 
Iget  Office,  1978).  Freeman  (1982)  has  argued  and  we  agree  that  the 
>loyment-to~population  ratio  is  a  more  reliable  indicator  of  youth 
:ivity.  In  both  time-series  and  cross-sectional  data,  he  finds  that 
.  percent  change  in  the  total  male  unemployment  rate  leads  to  a  1.7 
2.4  percent  change  in  the  employment-to-population  ratio  for  youths 
id  16-19  and  a  1.5  to  3.4  percent  change  for  those  aged  20-24 
eeman,  1980) .  Bowers  has  reviewed  the  employment  experiences  of 
icks,  teenagers  aged  16-19,  and  women  during  all  business  cycles  from 
i8  to  1980,  and  he  also  concludes  (Bowers,  1981)  that  teenagers  and 
icks,  both  in  the  aggregate  economy  and  in  key  cyclical  sectors, 

:fer  a  disproportionate  share  of  the  decline  in  employment  that 
:urs  during  economic  recessions. 

It  should  be  noted  that  when  the  adult  male  unemployment  rate  was 
inding  upward  over  the  past  2  decades  (even  from  peak  to  peak  in  the 
;iness  cycles) ,  the  foregoing  relationships  imply  that  there  would  be 
even  greater  deterioration  in  the  employment  situation  for  the 
mage  group.  Such  data  provide  only  a  crude  indicator,  of  course,  of 
i  complex  relationships  that  exist  between  the  employment  problems  of 
inagers  and  the  evolution  of  the  macroeconomic  situation  in  the 
ion.  Nonetheless,  there  appears  to  be  substantial  agreement  among 
;t  researchers  that  a  relatively  high  level  of  economic  activity  is 
ential  for  any  long-term  improvement  in  the  youth  employment 
mat ion. 


lustrial  and  Geographical  Shifts  in  the  Economy 

From  year  to  year,  the  American  economy  changes.  Wealth  increases 
l  tastes  change,  new  technologies  are  discovered  and  brought  on  line, 
i  factors  of  production  or  natural  resources  are  used  up  and  new  ones 
md,  foreign  trade  opens  up  opportunities  for  some  U.S.  goods  and 
ates  intense  competition  for  others.  At  the  same  time,  broad  shifts 
r  occur  in  where  people  want  to  live,  from  one  region  to  another  or 
m  cities  to  suburbs  or  from  suburbs  to  rural  areas.  These  changes 
:  very  likely  to  lead  to  shifts  in  the  demand  for  young  workers  over 
le,  although  the  precise  links  may  be  hard  to  trace.  If  wage  rates 
other  factors  of  production  were  totally  flexible — as  in  classical 
nomic  models — supply  and  demand  would  quickly  adjust,  but  such  is 
:  the  case  in  reality. 

The  decline  of  agriculture  and  the  movement  of  black  families  from 
ithern  rural  areas  to  northern  cities  explains  some  of  the  widening 


black/white  youth  unemployment  gap  in  the  1950s  and  early  1960s 
(1982),  Lerman  (1980a),  and  Mare  and  Winship  (1983),  among  othe 
pointed  out  that  in  1950  young  black  men  in  farm  areas  of  the  £ 
experienced  minimal  unemployment  (e.g.,  3  percent  for  18-  to  IS 
year-olds).  At  the  same  time,  the  unemployment  rate  for  urban 
black  men  was  20  percent,  substantially  higher  than  for  whites, 
large-scale  flow  of  blacks  northward  and  from  rural  to  urban  ar 
would  thus,  all  else  being  equal,  contribute  to  an  increased  dd 
between  the  unemployment  rates  of  white  and  black  males  (since 
black  migrants  would  now,  presumably,  suffer  from  unemployment 
higher  rate  characteristic  of  black  urban  residents).  However, 
1970  migratory  patterns  have  changed,  and  the  racial  differentd 
been  increasing  in  all  regions.  Migration  alone  cannot  explair 
phenomenon . 

Another  possible  cause  of  a  downward  shift  in  demand  for  yc 
particularly  for  blacks,  is  the  movement  of  jobs  from  the  inner 
to  the  suburbs  and  beyond  (a  move  resulting  in  large  part  becai 
and  other  costs  are  lower)  .  This  is  a  matter  of  some  dispute  d 
economics  literature.  Leonard  (1984)  has  found,  for  example,  t 
ratio  of  black  to  total  employment  in  any  given  firm  in  Los  Anc 
Chicago  in  the  1970s  varied  inversely  with  distance  from  the  bJ 
ghetto.  Over  time,  the  loss  of  employment  in  the  cities  has  re 
in  an  appreciable  loss  of  jobs  for  blacks  who,  apparently  becai 
racial  discrimination,  do  not  follow  the  jobs  as  they  move  into 
suburbs  and  nonmetropolitan  areas.  However,  this  movement  of  j 
from  where  blacks  live  cannot  explain  the  black/white  different 
persists  within  inner  cities.  Ellwood  (1983),  for  example,  has 
that  in  Chicago  distance  from  jobs  was  a  weak  predictor  of  emp] 
for  black  and  white  youths  living  in  adjacent  neighborhoods,  b] 
youth  employment  could  be  as  much  as  20  percent  lower  than  whit 
employment;  similarly,  blacks  in  neighborhoods  near  jobs  were  r 
likely  to  be  employed  than  blacks  in  neighborhoods  far  away  frc 


Minimum  Wage  Laws  and  Other  Government  Interventions 

Low  wages  are  an  unfortunate  fact  of  life  for  many  young  wc 
America.  Since  low-wage  workers  are  more  likely  to  have  their 
affected  by  the  statutory  minimum  wages,  much  of  the  concern  at 
policy  implications  of  minimum  wages  has  focused  on  the  impact 
minimum  wages  on  the  youth  labor  market.  There  have  been  sevc 
comprehensive  reviews  of  the  impact  of  minimum  wage  laws  on  th< 
labor  market  (Brown  et  al.,  1982;  Freeman,  1982;  Report  of  the 
Wage  Study  Commission,  1981;  Welch  and  Cunningham,  1978;  Mincei 
Rosters  and  Welch,  1972) .  Most  estimates  of  the  disemployment 
are  relatively  small.  The  estimates  from  time-series  data  ind: 
that  the  disemployment  effects  for  white  males  resulting  from  c 
percent  increase  in  the  statutory  minimum  would  reduce  the  lev< 
employment  by  1-3  percent  (Freeman,  1980)  .  For  young  blacks  ai 
there  are  larger  estimated  effects,  and  the  greatest  effects  oi 
employment  are  for  the  youngest  workers.  Theoretically,  nonwhi 


should  experience  greater  levels  of  disemployment,  but  Brown,  Gilroy, 
and  Kohen  (1982)  could  find  no  convincing  evidence  that  this  occurs. 

Economic  researchers  have  also  become  interested  in  the  nonemploy¬ 
ment  influences  of  a  statutory  minimum  wage.  Hashimoto  (1982) ,  Lazear 
and  Miller  (1981) ,  and  Fleisher  (1981)  have  argued  that,  in  addition  to 
whatever  disemployment  effects  are  caused,  the  minimum  wage  will  also 
prevent  young  people  from  being  able  to  engage  in  on-the-job  training. 
These  human  capital  theorists  propose  a  model  in  which  an  employee's 
full  wage  has  a  market  wage  and  an  unmeasured  component  of  on-the-job 
training  that  shows  up  in  future  wage  growth.  Using  the  National 
Longitudinal  Survey  (NLS)  between  1966  and  1969,  Hashimoto  (1982) 
estimates  that  the  loss  in  earnings  growth  would  be  between  2.7  and  15 
percent  of  the  observed  wage  of  workers.  It  seems  unlikely,  however, 
that  the  minimum  wage  could  explain  the  increasing  gap  in  employment 
between  adults  and  youths  (particularly  minorities  and  women)  since,  in 
real  terms,  the  minimum  wage  has  been  declining  in  recent  years.** 


Discrimination 

Discrimination  could  contribute  to  youth  employment  problems  in  the 
form  of  discrimination  on  the  basis  of  age  or  on  the  basis  of  race  or 


**In  addition  to  whatever  disemployment  or  nonemployment  is  caused  by 
the  minimum  wage  on  the  demand  side,  the  existence  of  income  maintenance 
programs  may  work  (along  with  minimum  wage  laws)  to  provide  an  alterna¬ 
tive  to  work  for  children  of  families  receiving  income  maintenance. 

Thus,  these  government  interventions  might  affect  the  supply  of  labor. 
Betsey  and  Dunson  (1981)  find  that  part  of  the  estimated  minimum  wage 
impact  may  be  attributable  to  increases  in  welfare  payments.  It  is 
clear  that  in  trying  to  assess  the  impact  of  minimum  wages  one  has  to 
also  consider  changes  in  other  income  maintenance  programs. 

Venti  (1984)  has  estimated  the  disemployment  effects  caused  by  one 
income  maintenance  program,  using  data  from  the  Seattle-Denver  Income 
Maintenance  Experiment.  This  experiment  offered  benefits  well  in 
excess  of  contemporary  welfare  programs  (e.g.,  financial  support  levels 
for  a  family  of  four  of  $3,800,  $4,800,  and  $5,600  in  constant  1971 
dollars)  .  Venti  finds  that  this  income  maintenance  program  had  large 
disemployment  effects,  but  that  when  one  considers  the  choice  as  a 
joint  one  with  the  decision  to  go  to  school,  almost  all  of  the 
disemployment  is  a  movement  into  schooling,  not  into  idleness,  venti 
and  Wise  (1984)  argue  that  interpretation  of  these  results  requires  an 
allowance  for  schooling  decisions  because  analysis  of  "the  simple  work 
effect  may  be  an  incomplete  indicator  of  the  social  and  economic 
consequences  of  an  income  maintenance  program."  Of  course,  in  turn, 
one  does  not  know  whether  some  of  this  movement  into  schooling  may 
represent  disguised  idleness:  Are  youths  using  their  time  to  gain  real 
market  skills  through  schooling  or  simply  disguising  their  problem  with 
unproductive  schooling? 


productivity,  costs  of  training,  and  turnover  associated  witn  5 
workers  (Freeman,  1980)  .  There  have  been  few  attempts  to  estat 
such  relationships  empirically.  Discrimination  studies  have  cc 
sistently  shown  black  adult  workers  to  have  lower  earnings  thar 
after  the  measured  individual  characteristics  have  been  contro] 
a  large  part  of  this  earnings  differential  is  associated  with  t 
probability  of  employment  rather  than  differences  in  wages. 

With  respect  to  wages  and  earnings  (net  of  weeks  worked)  ar 
human  capital  variables  (e.g.,  education),  economists  have  gene 
found  substantial  evidence  of  discrimination  in  wages  prior  to 
mid-1960s,  but  in  more  recent  years  the  available  evidence  sugc 
that  discrimination  in  wage  rates  by  race  has  been  narrowed  (Re 
1983)  or  effectively  ended  (Osterman,  1980?  Freeman,  1973)  .  Fc 
workers,  however,  the  situation  is  quite  different.  Among  ful] 
year-round  workers,  the  earnings  of  women  average  less  than  60 
of  those  of  men,  and  young  women  (age  20-24  years)  earn  approxi 
87  percent  as  much  as  young  men.  A  National  Research  Council  i 
discrimination  in  wage-setting  found  that  the  evidence  "suggest 
only  a  small  part  of  the  earnings  differences  between  men  and  \ 
be  accounted  for  by  differences  in  education,  labor  force  expei 
labor  force  commitment,  or  other  human  capital  type  factors  be] 
contribute  to  productivity  differences  among  workers"  (Treiman 
Hartman,  1981).  A  major  confounding  factor  is  the  substantial 
tional  segregation  of  the  work  force — with  women  being  concentr 
occupations  that  are  low  paying. 

With  respect  to  employment — in  contrast  to  wages — efforts  t 
reported  by  Osterman  (1980b)  to  account  for  the  disparity  in  ur 
ment  rates  between  whites  and  blacks  on  the  basis  of  standard  1 
capital  variables.  He  found  that  about  one-half  of  the  gap  in 
ment  rates  between  young  black  and  white  workers  could  be  accoi 
for:  if  one  followed  the  convention  used  in  the  earnings  litei 
the  residual  gap  would  be  attributed  to  discrimination  (Osterm; 
1980b)  .  The  actual  mechanics  by  which  this  discrimination  opei 
difficult  to  specify.  Culp  and  Dunson  (1983)  present  findings 
pilot  study  suggesting  that  treatment  of  job  applicants  with  tl 
backgrounds  and  qualifications  may  depend  in  many  crucial  ways 
race  of  the  applicant.  There  is  also  evidence  (Rossi  and  Ornsl 
1973)  suggesting  that  the  social  networks  and  friendships  used 

jobs  are  segregated  by  race,  resulting  in  some  disadvantage  to 
youths. 

While  discrimination  may  account  for  differences  between  b] 
whites  at  a  given  point  in  time,  it  is  more  difficult  to  estabj 
increases  m  discrimination  in  the  late  1960s  and  the  1970s  wei 
important  factor  in  explaining  the  increasing  differential  in  < 
between  young  blacks  and  young  whites. 


Antidiscrimination  Laws  and  Enforcement 


The  three  key  pieces  of  statutory  and  administrative  policy  that 
affect  the  level  of  discrimination  in  society — Title  VII  of  the  1964 
Civil  Rights  Act,  Executive  Order  11246,  and  the  Equal  Pay  Act  of 
1962 — emphasize  the  job  market  opportunities  of  entrants  or  reentrants 
into  the  job  market.  All  three  were  enacted  or  issued  before  the 
employment  problems  of  young  people  were  generally  viewed  as  central 
issues  in  the  society. 

Analysts  disagree  on  how  effective  Title  VII  (and  other  measures) 
can  be  for  young  minority  and  female  workers.  The  statute  exempts  many 
small  employers  from  the  statutory  scheme.  When  the  act  became 
effective  on  July  2,  1965,  it  applied  only  to  employers  of  100  workers 
or  more.  The  current  limit  is  15  workers,  which  still  excludes  coverage 
for  many  young  people  employed  in  small  stores  and  restaurants.  More 
than  one-third  of  all  youths  aged  16-24  work  in  retail  trade,  including 
restaurants,  and  many  of  these  are  small  operations  not  covered  by 
Title  VII. 

In  addition  to  jobs  not  being  covered  by  Title  VII  or  corresponding 
limitations  in  Executive  Order  11246,  many  young  workers  may  find  the 
cost  of  litigation  to  be  too  great,  given  their  lack  of  commitment  to  a 
particular  job.  In  order  to  bring  pressure  on  a  recalcitrant  employer, 
someone  must  be  willing  to  complain  and  involve  himself  or  herself  in 
the  expensive  and  time-consuming  process  of  enforcing  the  statute's 
prohibitions  against  discrimination.  One  would  expect  the  willingness 
to  finance  and  bring  suits  to  be  positively  related  to  expected  length 
of  job  tenure  and  the  relative  attractiveness  of  that  job  in  comparison 
with  other  possible  job  opportunities  for  the  potential  complainant. 

Both  of  these  factors  tend  to  be  lacking  in  many  jobs  that  young  people 
have. 

Questions  have  sometimes  been  raised  about  potential  disemployment 
effects  of  antidiscrimination  laws  and  affirmative  action  programs.  By 
raising  black  youths'  wages,  have  they  reduced  employment?  Freeman  and 
Holzer  (1985)  reply  to  this  question  by  noting  that  the  laws  and  pro¬ 
grams  are  intended  to  change  the  demand  for  labor,  not  wages?  they 
assume  nondiscrimination  in  wage  setting  and  attempt  to  increase  the 
demand  for  minority  and  female  workers.  According  to  Freeman  and 
Holzer  (1985)  the  most  reliable  assessments  of  the  effects  of  affirma¬ 
tive  action  programs  indicate  that  the  programs  do  increase  employment 
of  these  groups,  although  this  claim  has  been  disputed  in  the  economics 
literature. 


Demand  for  Military  Personnel 

Service  in  the  military  has  long  been  an  important  employment 
experience  for  young  males,  although  the  proportion  of  youths  serving 
in  the  armed  forces  has  been  declining  since  the  late  1960s.  Despite 
this  decline,  the  availability  of  employment  in  the  military  is  impor¬ 
tant  for  some  groups  of  the  youth  population.  In  1984,  9  percent  of 
nonwhite  males  aged  18-24  were  in  military  service;  the  total  number  of 


approximately  224,000  is  quite  substantial  when  viewed  in  perspective 
with  the  number  of  nonwhite  male  youths  of  the  same  age  who  were 
employed  in  civilian  occupations  (1.1  million)  .  Changing  patterns  oi 
military  service  by  different  racial  groups  masked  some  of  the  diffei 
ential  in  civilian  employment  between  black  and  white  youths.  Durinc 
the  1970s  white  youths'  participation  in  the  military  declined  sub¬ 
stantially  while  black  youths'  participation  remained  approximately 
constant  (Ellwood  and  Wise,  1983).  If,  after  1972,  the  proportion  oJ 
black  youths  in  the  military  had  declined  in  proportion  to  the  white 
decline,  the  proportion  of  black  youths  without  work  in  1982  would  he 
have  risen  by  about  3  percent  (Mare  and  Winship,  1983)  .  (Participate 
in  military  service  by  females  involved  only  0.6  percent  of  white 
females  and  1.4  percent  of  nonwhite  females  in  1984.) 


Factors  Affecting  the  Supply  of  Labor 
Demographic  Trends 

During  the  1970s  several  demographic  trends  might  have  affected 
youth  employment.  First,  and  most  prominent,  was  the  entry  of  the 
massive  baby-boom  generation  into  the  labor  force.  Theory  suggests 
that  as  the  supply  of  young  workers  rises  relative  to  the  supply  of 
both  older  workers  and  other  factors  of  production,  youth  wages  or 
employment  will  fall  relative  to  that  of  older  workers.  Indeed,  in  c 
cross-sectional  analysis  of  standard  metropolitan  statistical  areas. 
Freeman  (1982)  found  that  as  the  youth  share  of  the  population 
increased,  employment  prospects  declined  by  a  moderate  amount, 
particularly  for  those  aged  16-17.  However,  analysis  by  Wachter  and 
Kim  (1982)  suggests  that,  at  a  national  level  and  over  time,  the 
primary  effect  appears  to  have  been  on  wages.  For  example,  as  shown 
Tables  2.2a  and  2.2b,  during  the  period  of  rapid  expansion  of  the  yoi 
labor  force,  1957  to  1978,  the  employment- to-population  rate  for  whit 
youths  stabilized  or  actually  increased.  In  contrast.  Table  2.8  shov 
that  during  the  1970s  the  wages  of  white  youths  declined  relative  to 
adult  wages.  Whatever  the  effects  of  this  large  demographic  bulge,  : 
did  not  overcome  other  factors  tending  to  raise  the  employment- to- 
population  rate  for  white  youths,  but  it  may  have  played  a  role  in 
lowering  their  relative  wages.  Among  black  youths,  however,  the 
pattern  appears  different:  relative  wages  over  those  years  declined 
less  than  those  of  white  youths,  but  unemployment  rose  and  employmenl 
rates  fell  substantially. 

Two  other  factors  increased  the  supply  of  labor  during  the  same 
period:  the  sharp  and  continuing  rise  in  the  labor  force  participate 
of  adult  women  (see  Hahn  and  Lerman,  1983)  and  the  influx  of  immigrar 
workers  into  the  United  States.  Each  of  those  groups  might  draw  jobs 
away  from  youths  if  they  enter  the  labor  market  in  part-time  or  low- 
skill  jobs  (particularly  if  employers  prefer  to  discriminate  in  theii 
favor  or  can  pay  lower  wages  to  these  groups)  .  It  is  possible  that 
increased  numbers  of  women  in  the  labor  force  may  have  worsened  the 
employment  prospects  and  lowered  the  wage  rates  of  youths  (Bor j as. 


1983),  although  there  have  been  few  studies  of  such  effects.  Estimating 
the  employment  interactions  between  youths  and  immigrants  has  been 
difficult  because  of  the  lack  of  reliable  data  on  the  illegal  component 
of  the  immigrant  work  force.  However,  Freeman  and  Holzer  (1985)  report 
that  there  is  no  evidence  to  support  the  view  that  increases  in  the 
Hispanic  population  (which  accounts  for  a  substantial  number  of 
immigrants)  have  hurt  job  opportunities  for  black  youths,  since  black 
youth  unemployment  rates  are  similar  in  cities  with  large  and  small 
Hispanic  populations. 

A  fourth  demographic  development  of  considerable  importance  is  the 
change  in  childbearing  and  marital  patterns  in  the  youth  population. 
During  the  1970s  there  was  both  a  decline  in  the  rate  of  marriage  among 
youths  and  an  increase  in  divorce  among  those  who  did  marry.  It  is 
possible  that  these  changes  might  increase  the  supply  of  female  labor. 
While  childbearing  declined  sharply  among  young  married  women,  it  did 
not  decline  among  unmarried  women.  Births  to  unmarried  women  tripled 
as  a  share  of  all  births  between  1960  and  1979  (although  their  number 
did  not  rise) .  In  1983  among  married  and  unmarried  women  aged  18-24, 
there  were  965  births  per  1,000  female  high  school  dropouts  and  506 
births  per  1,000  female  high  school  graduates  who  did  not  attend 
college  (U.S.  Bureau  of  the  Census,  1984:Table  4). 

Since  young,  unmarried  women  with  children  have  disproportionately 
lower  incomes  and  consequently  may  have  difficulty  obtaining  affordable 
child  care,  they  may  have  more  difficulty  in  finding  and  holding  jobs 
than  other  young  people.  However,  while  the  magnitude  of  this  effect 
has  not  been  estimated  for  youths,  there  is  evidence  that  lack  of 
satisfactory  child  care  is  a  restraint  on  women's  employment  (Presser 
and  Baldwin,  1980).  (As  noted  in  Chapter  1,  research  on  this  important 
topic  should  be  encouraged.) 

As  we  noted  above,  there  has  been  a  substantial  expansion  of  the 
youth  labor  supply  over  the  last  several  decades,  resulting  from 
changes  in  birth  rates  during  the  immediate  postwar  period  and  sub¬ 
stantial  increases  in  the  number  of  young  women  who  entered  the  labor 
market.  To  the  extent  that  an  excess  of  "supply"  is  (by  definition)  a 
prerequisite  for  unemployment,  it  is  prudent  to  ask  whether  this  growth 
in  the  supply  of  young  workers  will  continue  in  the  next  decade. 

Since  one  aspect  of  such  a  forecast  involves  making  assumptions 
about  the  future  decisions  of  millions  of  young  women,  any  answer  would 
be  quite  speculative.  It  may  not  be  unreasonable  to  expect  the  rate  of 
female  participation  in  the  labor  force  to  approximate  that  of  men,  but 
it  may  also  not  be  unreasonable  to  speculate  that  traditional  patterns 
will  die  hard,  thus  restraining  further  large  jumps  in  the  rate  of 
female  participation  in  the  labor  market. 

There  is,  however,  one  aspect  of  a  forecast  about  which  we  do  have 
some  "hard"  evidence:  the  1990s  "supply"  of  teenagers  has  already  been 
born,  and  barring  massive  changes  in  death  rates  or  patterns  of  migra¬ 
tion,  one  can  venture  a  prospective  count  of  their  numbers.  Figure  2.1 
shows  the  actual  and  projected  size  of  the  older  teenage  population  for 
1960-2000.  For  the  period  1960  through  1982,  this  segment  of  the 
population  grew  from  roughly  13  million  to  more  than  21  million  in  1980 
and  then  began  to  decline.  In  1982  the  population  aged  15-19  totaled 
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FIGURE  2.1  Actual  and  projected  trends  in  the  youth  population 
15-19,  1960-2000. 


NOTE:  The  1970  and  1980  figures  are  population  counts  from  dece 
censuses  reported  in  U.S.  Department  of  Commerce  (1985:Table  30) 
1960  figures  are  population  counts  from  the  1960  decennial  censu 
reprinted  in  Bureau  of  the  Census  (1973:Table  189).  The  1975,  1 
and  1982  figures  are  estimates  based  on  Current  Population  Surve 
sample  surveys  of  population  as  reported  in  Bureau  of  the  Census 
1982) .  The  1985-2000  figures  are  population  projections  (middle 
series)  made  by  and  reported  in  Bureau  of  the  Census  (1982)  . 


19.8  million.  When  the  size  of  this  population  group  is  project 
later  years,  it  shows  continuing  declines  through  1995;  at  that 
is  roughly  80  percent  of  its  peak  (1980)  size.  Thus,  on  the  sue 
side,  the  demographic  projections  indicate  that  there  will  be  a 
decline  in  the  number  of  E>otential  participants  in  the  labor  mar 
through  1995. 


Enrollment  in  School 

Changes  in  school  enrollment  patterns  could  have  a  direct  ei 
the  measured  extent  of  unemployment  problems  among  youths  (Hahn 
Lerman,  1983).  During  the  1960s  and  1970s,  the  enrollment  rates 
white  males  declined  somewhat  and  those  for  white  women  and  blac 


TABLE  2.9  Percentage  of  Persons  Aged 
16-24  Enrolled  in  School,  by  Race  and  Sex 


Group 

1964 

1974 

1983 

White  males 

51.0 

45.8 

44.7 

Nonwhite  males 

39.4 

48.5 

45.4 

White  females 

36.4 

39.1 

40.7 

Nonwhite  females 

34.1 

38.6 

40.9 

SOURCE:  Data  from  Bureau  of  Labor 
Statistics  (1982,  1984). 


both  sexes  increased  (see  Table  2.9)  .  The  difference  in  the  patterns 
of  school  enrollment  between  blacks  and  whites  contributed  in  part  to 
the  growing  differential  in  employment-to-population  ratios  between 
black  and  white  youths  (Freeman,  1980) .  The  declining  school  enroll¬ 
ment  rate  of  whites  would  tend  to  increase  their  employment  rates  since 
the  employment  rate  for  those  out  of  school  is  generally  higher  than 
that  for  those  in  school.  However,  most  of  the  increased  employment 
for  young  whites  in  the  past  two  decades  came  from  rising  employment 
rates  for  in-school  youths. 

More  interesting  than  the  question  of  enrollment  status  is  the 
degree  to  which  educational  attainment  has  an  effect  on  the  labor 
market  experiences  of  youths.  Many  studies  indicate  that  dropouts  have 
a  more  difficult  time  in  the  labor  market  than  do  high  school  graduates. 
These  effects  are  seen  in  difficulties  in  obtaining  the  first  job,  in 
duration  of  unemployment  between  jobs,  and  in  wage  rates.  Academic 
performance  appears  to  be  positively  related  to  both  number  of  weeks 
employed  and  wage  rates  for  youths.  Other  studies  find  that  vocational 
training  in  high  school  appears  to  be  unrelated  to  employment  and  wage 
rates,  while  there  are  some  indications  that  vocational  training  after 
high  school  may  have  some  positive  effects  (Freeman  and  Wise,  1982). 

These  findings  on  the  effects  of  education  on  employment  experi¬ 
ences  may  help  to  explain  the  distribution  of  employment  and  unemploy¬ 
ment  among  youth  groups,  but  they  do  not  appear  to  help  to  explain  the 
growing  differential  between  black  and  white  youths.  One  explanation 
that  has  been  put  forward  is  that  differences  in  the  quality  of  educa¬ 
tion  are  responsible  for  the  growing  differential.  The  validity  of 
this  explanation  is  difficult  to  test.  Studies  of  functional  literacy 
do  show  that  literacy  rates  are  lower  among  blacks  than  among  whites, 
but  there  is  no  indication  that  this  gap  has  widened  over  recent 
years.  Similarly,  while  there  has  been  some  overall  decline  in  the 
Scholastic  Aptitude  Test  (SAT)  and  other  test  scores,  there  is  no 
indication  that  racial  differentials  in  test  scores  have  increased  over 
time  (Hahn  and  Lerman,  1983)  . 


Youths'  Expectations  and  the  Reservation  Wage 


The  "reservation  wage"  of  a  person  is  defined  as  the  lowest  wa 
which  that  person  would  be  willing  to  take  a  job.  It  has  been  sug 
that  some  of  the  employment  problems  of  youths  may  be  related  to  a 
reservation  wage  that  is  too  high.  In  addition,  some  analysts  arg 
that  increasing  incomes  throughout  the  society  have  caused  the  lev 
the  reservation  wage  to  rise  over  time  to  a  greater  degree  than 
warranted  by  the  increasing  skills  of  the  labor  force. 

Data  on  reservation  wages  have  not  been  collected  over  long  en 
periods  of  time  for  conclusions  to  be  drawn  as  to  whether  rising 
reservation  wages  have  been  a  major  cause  of  increased  unemploymen 
younger  workers.  On  the  whole,  recent  studies  find  (e.g. ,  Freeman 
Holzer,  1985)  that  the  reservation  wages  of  unemployed  younger  wor 
appear  on  average  to  be  quite  realistic?  both  white  and  black  you 
appear  to  have  reservation  wages  that  are  quite  close  to  the  preva 
federal  minimum  wage. 

While  the  reservation  wages  of  white  and  black  male  youths  are 
about  the  same,  Freeman  and  Holzer  suggest  that  the  fact  that  the 
employment  prospects  for  blacks  are  worse  means  that  their  reserva 
wages  are  higher  relative  to  the  actual  wages  they  are  likely  to  b 
able  to  obtain.  And  reservation  wages  for  specific  low-wage  jobs 
generally  lower  for  blacks  than  for  whites .  Reservation  wages  of 
blacks  appear  to  have  the  effect  of  lengthening  the  period  of  none 
ment  but  also  of  increasing  subsequent  wages.  The  reservation  wag 
young  whites  have  somewhat  less  effect  on  the  duration  of  nonemplo 
but  greater  effects  on  their  subsequent  wages. 


Summing  Individual  Effects 

Thus  far  we  have  been  serially  reviewing  possible  causes  of  th 
trends  in  youth  employment  problems  within  a  framework  of  demand  a 
supply  factors.  Two  sets  of  researchers,  Ellwood  and  Wise  (1983) 
Mare  and  Winship  (1983) ,  have  independently  sought  to  bring  togeth 
most  of  the  factors  covered  above  in  a  consistent  accounting  frame 
in  order  to  see  what  proportion  of  the  growth  in  the  gap  in  black/ 
youth  employment  rates  can  be  explained  by  the  sum  of  the  individu 
effects  of  all  the  factors.  Though  their  accounting  frameworks  ar 
quite  different,  both  sets  of  researchers  conclude  that  they  can 
account  for  only  about  50  percent  of  the  diverging  racial  employme 
patterns  among  youths  in  the  1970s. 

In  discussing  each  factor  separately  we  have  also  not  touched 
possible  (nonadditive)  interactions  among  factors;  such  interactio 
might  yield  results  that  are  different  from  the  simple  sum  of  each 
individual  factor.  Two  hypothetical  examples  can  illustrate  such 
interactions.  It  was  previously  noted  that  increases  in  the  suppl 
young  workers  seem  to  be  related  to  increases  in  employment  rates 
decreases  in  wages  (relative  to  adults)  for  young  white  males,  but 
seem  to  be  related  to  sharp  decreases  in  employment  rates  and  smal 
relative  wage  decreases  for  young  black  males.  These  differences  : 


due  to  the  interaction  of  the  increased  supply  of  labor  and  the 
stence  of  minimum  wage  rates  and  increased  civil  rights  enforcement 

affirmative  action  programs.  The  wages  of  young  black  males  were 
eady  closer  to  the  minimum  wage  than  were  those  of  young  whites,  so 
n  the  youth  labor  supply  increased  employers  had  less  room  to 
ipress  black  wages  than  white  wages.  [Hall  (1982)  suggests  this 
sibility  in  his  commentary  on  the  research  of  Wachter  and  Kim 
>82) .] 

A  second  possible  interaction  is  between  the  demographic  increase 
supply  and  employer  discrimination.  Even  if  the  desire  to  discrimi- 
:e  on  the  part  of  employers  was  not  increasing  during  recent  decades, 
i  increase  in  the  supply  of  both  young  whites  and  blacks  may  have 
:reased  the  scope  for  the  exercise  of  discriminatory  hiring  by 
>loyers.5  This  theoretical  possibility  was  emphasized  in  the 
liest  exposition  of  an  economic  theory  of  discrimination  by  Becker 
57) . 

While  these  higher-order  interactions  generate  interesting 
•otheses,  they  are  extraordinarily  difficult  to  assess  empirically, 
ticularly  when  they  involve  such  factors  as  the  minimum  wage  or 
icrimination ,  which  have  proved  challenging  to  assess  even  as 
igular  first-order  factors. 


Other  Influences  on  Youth  Employment 

Several  research  findings  do  not  fit  neatly  into  the  supply  and 
land  framework  we  have  used  in  the  preceding  sections  of  this 
ipter.  We  note  several  of  these  briefly  and  then  turn  to  a  dis- 
ision  of  social  context. 


lily  Influences  and  Teenage  Experiences 

Family  background  has  a  positive  relationship  to  the  probability 
it  a  young  person  is  employed,  and  Meyer  and  Wise  (1982)  find  that  an 
:rease  of  $5,000  in  parental  income  is  associated  with  an  increase  of 
:e  than  three  weeks  in  the  number  of  weeks  worked  by  teenagers. 

Other  family  structure  factors  do  seem  to  affect  employment 
labilities  (see  Rees  and  Gray,  1982;  Corcoran,  1982).  Youths  with 
>lings  working  are  more  likely  to  be  working  themselves,  suggesting 
i  importance  of  family  connections  for  information  or  role  models. 


imilarly,  in  the  increasing  concern  with  civil  rights  and 
iirmative  action  there  may  have  been  greater  pressure  for  equal  wage 
latment,  leading  employers  to  make  more  of  their  adjustment  to 
:reased  supply  by  decreased  hiring  of  blacks.  Freeman  (1985)  rejects 
.s  hypothesis,  arguing  that  affirmative  action  increases  relative 
iloyment  of  blacks  by  punishing  discrimination  in  employment  as  well 
in  wage  setting. 


later  employment  and  wage  rates.  Whether  the  relationship  is  reall 
causal  or  simply  correlative  (i.e.,  due  to  a  common  underlying  fact 
such  as  motivation)  remains  unclear.  Obviously,  for  those  interest 
in  the  potential  benefits  from  employment  and  training  programs  for 
in-school  youths,  this  finding  is  intriguing. 

A  final  finding  that  has  drawn  the  attention  of  many  analysts  i 
that  the  long-term  (i.e.,  4-5  years  later)  effects  of  unemployment 
during  younger  years  appear  to  be  rather  less  than  had  been  previou 
suggested.  Once  individual  characteristics  have  been  controlled  fc 
the  experience  of  early  unemployment  does  not  appear  to  raise  the 
probability  of  unemployment  in  the  following  4-5  years.  This  resul 
appears  to  hold  for  both  young  men  and  young  women  (Ellwood,  1982; 
Corcoran,  1982) .  In  addition,  once  individual  characteristics  are 
constant,  initial  wage  levels  seem  to  have  little  relationship  to  w 
levels  4-5  years  later.  These  relatively  encouraging  findings  abou 
the  limited  effects  of  early  unemployment  and  wages  are,  however, 
counterbalanced  by  another  finding:  early  unemployment  experience 
seem  to  affect  wage  levels  4-5  years  later ,  and  this  effect  appears 
be  stronger  and  more  substantial  for  youths  with  lower  levels  of 
education. 


Social  Context 

We  conclude  by  noting  a  final  factor  that  may  strongly  influenc 
the  employment  experiences  of  young  minority  youths:  the  social 
context  that  has  formed  their  perceptions  and  responses.  We  have 
chosen  to  discuss  this  issue  of  social  context  in  the  final  part  of 
this  section  because  it  affects  both  the  supply  and  the  demand  for 
labor  and  because  the  effects  may  be  strong.  The  residue  of  past  a 
current  discrimination  finds  its  expression  on  the  demand  side  in 
diminished  opportunities  for  minority  youths  in  the  labor  market 
(because  of  the  attitudes  of  employers) ;  and,  to  the  extent  that  th 
social  context  affects  the  perceptions,  attitudes,  and  responses  of 
youths,  it  can  have  a  quite  fundamental  impact  on  the  supply  of  lat 

The  long  history  of  the  exclusion  of  blacks  from  social  and 
economic  power,  government,  and  prestigious  occupations  affects  you 
in  many  ways.  As  Ogbu  (1985a,  1985b)  has  observed  in  his  study  of 
minority  youths  in  Stockton,  California,  there  is  a  racial  or  caste 
stratification  between  blacks  and  whites  that  historically  found 
expression  in  such  things  as  job  ceilings  for  black  workers.  A  pi] 
project  by  Culp  and  Dunson  (1983)  finds  evidence  of  such  stratifies 
in  the  treatment  of  matched  young  black  and  white  "auditors"  who 
applied  for  jobs  at  firms  in  the  Newark,  New  Jersey,  area.  The 
auditors  were  recent  high  school  graduates  who  were  trained  to  make 
systematic  observations  of  their  treatment.  Although  the  study  was 


a  pilot  project  and  the  samples  were  too  small  for  statistical 
ng,  the  results  suggested  that  black  youths  may  be  treated  with 
courtesy  and  may  be  less  likely  to  be  informed  of  job  prospects 
1  and  Dunson,  1983).  Other  independent  anthropological  studies 
,  Ogbu,  1985b)  have  found  evidence  of  negative  stereotyping  of 
ncome  blacks. 

he  collective  adaptation  of  black  youths  to  this  and  other  features 
stratification  system  may  be  a  source  of  the  disproportionate 
of  black  school  failure  and  unemployment.  In  the  face  of  bleak 
e  prospects,  diligence  in  school  may  not  appear  to  be  adaptive  to 
.1  reality,  but  rather  may  be  seen  as  "doing  the  white  man's  thing" 
1985a?  Anderson,  in  this  volume;  and  Foster,  1974). 
he  castelike  stratification  of  minorities  has  effects  beyond  those 
uths"  perceptions.  The  historic  exclusion  of  minorities  from  some 
ations  deprives  them  of  the  chance  to  learn  the  requirements  of 
employment  and  to  undertake  the  necessary  preparation.  Minority 
ren  will  be  limited  in  their  opportunity  to  observe  role  models 
ing  such  occupations,  and  parents,  having  been  excluded  by  past 
imination,  will  often  be  unable  to  guide  and  advise  their  children 
e  preparations  required  for  such  occupations.  This  may  result  in 
rth  of  knowledge  on  the  part  of  the  child  and  entirely  inappro- 
e  preparation  for  desired  "mainstream"  occupations.  In  one  study 
,  1985a) ,  it  was  reported  that  black  high  school  students  desiring 
come  doctors,  engineers,  and  teachers  were  as  likely  to  take  shop 
es  as  those  desiring  office  work.  Similarly,  minority  youths  who 
ed  to  be  engineers  took  no  more  mathematics  courses  in  high  school 
youths  wishing  to  become  physical  education  teachers.  What  such 
ngs  make  clear  is  not  only  that  children  did  not  learn  about  the 
rements  of  those  occupations  in  their  home  environment,  but  also 
the  schools  did  little,  if  anything,  to  convey  crucial  information, 
nderson  (in  this  volume)  emphasizes  the  increasing  significance  of 
factors  in  determining  the  social  context  in  which  black  and 
minority  inner-city  youths  are  raised.  The  substantial  increase 
e  size  of  the  black  middle  and  upper  classes  in  recent  years  has 
ted  in  greater  residential  dispersion  of  higher-income  blacks 
n  the  metropolitan  area:  black  inner-city  communities  have 
ienced  a  loss  of  leadership  and  important  role  models  that  has 
ibuted  to  the  problems  faced  by  the  remaining  youths. 


DEVELOPMENTS  SINCE  1980 

s  the  Youth  Employment  and  Demonstration  Projects  Act  (YEDPA) 
ams  ended  in  1981,  the  U.S.  economy  had  begun  its  descent  into  the 
recession  since  the  1930s.  The  economy  bottomed  out  at  the  end 
82  with  overall  unemployment  at  a  post -World  War  II  high  of  10.8 
nt.  The  unemployment  rate  of  youths  aged  16-19  was  more  than 
e  that  at  24.5  percent. 

he  greater  sensitivity  of  youth  employment  to  the  business  cycle 
previously  can  be  seen  for  this  period  as  well  in  the  data  on 
yment-to-population  rates  given  in  Table  2.10.  In  1978  the 


Year 

Employment- to- Population  Rate 

All  Civilian 
Workers 
(1) 

All  Youths 
Aged  16-19 
(2) 

Ratio 

(l)/(2) 

1977 

57.9 

46.1 

.796 

1978 

59.3 

48.3 

.814 

1982 

57.8 

41.5 

.718 

1984 

59.5 

43.7 

.734 

SOURCE:  U.S.  Department  of  Labor  (1985:Table  B-12)  . 


employment-to-population  rates  for  all  civilian  workers  (column  ] 
59.3,  while  the  employment- to-population  rate  for  youths  aged  16- 
48.3  (column  2);  hence,  the  youth  rate  was  81.4  percent  of  that  i 
workers  (column  3) .  By  1982  the  employmen  t- to-popu  1  at  ion  rate  fc 
workers  had  fallen  sharply,  to  57.8,  but  the  rate  for  youths  had 
even  more  precipitously,  to  41.5,  so  that  the  youth  rate  was  only 
percent  of  the  rate  for  all  workers.  It  is  also  of  some  interest 
note  that  in  1982  the  employment-to-population  rate  for  all  worke 
at  about  the  same  level  as  in  1977  (57.8  and  57.9),  but  the  youtl: 
was  considerably  lower  in  1982  than  in  1977  (41.5  compared  with  4 
For  black  youths  the  employment  situation  in  1982  was  disastrous: 
their  employment-to-population  rate  was  only  19.0  percent. 

The  economic  recovery  began  in  1983  and  continued  through  19£ 
the  upswing  youth  employment  again  showed  greater  sensitivity  so 
by  1984  the  youth  employment-to-population  rate  had  recovered  moi 
that  for  all  workers:  it  was  73.4  percent  of  the  rate  for  all  wc 
(compared  with  71.8  percent  at  the  bottom  of  the  recession  in  19£ 
However,  if  one  compares  the  situation  in  1984  with  that  in  1978, 
clear  that,  despite  the  recovery,  the  youth  employment-to-populal 
situation  has  deteriorated  both  absolutely — from  48.3  in  1978  to 
in  1984 — and  relative  to  the  rest  of  the  labor  force — from  81.4  j 
of  the  rate  for  all  workers  in  1978  to  73.4  percent  in  1984. 

If  one  looks  back  to  Tables  2.2a  and  2.2b,  it  is  apparent  the 
employment-to-population  rate  for  nonwhite  males  (both  those  agec 
and  20-24)  is  not  only  worse  in  1984  than  it  was  in  1978  but  has 
deteriorated  relative  to  white  male  youths,  while  the  employment- 
population  rates  of  nonwhite  females  remain  the  lowest  of  the  yoi 
groups. 

These  very  summary  data  indicate  both  that,  as  would  be  expe< 
the  recession  hurt  youth  employment  seriously  and  also  that  even 
the  economic  recovery  youth  employment  problems  remain  very  seric 
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itpared  either  with  1977,  just  before  YEDPA  started,  or  1978,  the 
rst  year  of  the  program,  the  youth  employment  problem  in  1984  was  as 
3,  or  worse.  Even  more  disturbing,  the  employment  situation  of  black 
aths,  particularly  males,  has  worsened  even  more  relative  to  white 
jths,  apparently  continuing  the  long-term  trend  observed  up  to  1978. 

While  our  committee  has  not  tried  to  assess  systematically  the 
snomic  outlook  for  the  future  and  its  implications  for  youth  employ- 
nt  problems,  we  do  wish  to  comment  on  one  feature  that  has  sometimes 
sn  pointed  to  as  a  possibly  important  sensitive  development,  namely, 

2  decline  in  the  absolute  size  of  the  youth  cohort.  In  the  previous 
stion,  it  was  noted  that  one  of  the  possible  causes  of  youth  employ- 
nt  problems  was  the  massive,  unprecedented  rise  in  the  size  of  the 
th  cohort,  both  absolutely  and  relative  to  the  adult  worker  popula- 
Dn  (shown  in  Figure  2.1).  Over  the  15  years  from  1980,  when  the  size 
the  youth  population  reached  its  absolute  peak,  to  1995,  the  youth 
tiort  will  decline  from  21  million  to  about  17  million.  It  has  been 
ggested  that  this  decline  will  significantly  improve  the  employment 
tuation  for  youths. 

We  have  two  observations  to  make  about  this  suggestion.  First, 

Lie  there  are  some  indications  that  the  youth  demographic  bulge  may 
/e  contributed  to  youth  employment  problems,  the  evidence  is  by  no 
ans  overwhelming,  if  it  is  hard  to  find  the  effects  of  this  dramatic 
Lge  in  relative  supply  on  youth  employment  problems,  it  seems  unwise 
count  on  the  decline  in  relative  supply  of  youths  to  have  over¬ 
timing  effects  in  reducing  youth  employment  problems  over  the  next 
sade.  Second,  by  1985  two-thirds  of  the  total  projected  decline  in 
2  size  of  the  youth  population  will  have  occurred.  The  figures  just 
/iewed  above  give  no  indication  that  this  relative  supply  effect  is 
rrently  having  a  substantial  impact  on  youth  employment  problems,  if 
3uctions  in  relative  supply  of  youths  have  been  having  some  positive 
Eect,  they  have  not  been  substantial  enough  to  overcome  other 
jative  factors. 


POSTSCRIPT 

When  focusing  on  the  youth  unemployment  problem,  there  is  a 
ndency  to  lose  sight  of  the  fact  that  the  majority  of  teenagers  find 
ds  relatively  easily  and  that,  when  they  leave  or  lose  one  job,  they 
ten  find  another  without  a  long  period  of  unemployment.  As  Freeman 
3  Wise  (1982)  observe:  "constant  references  to  the  youth  employment 
Dblem,  as  if  all  or  the  majority  of  young  persons  had  trouble 
taining  jobs,  appear  to  misinterpret  the  nature  of  the  difficulty, 
nth  joblessness  is  in  fact  concentrated  among  a  small  group  who  lack 
ck  for  extended  periods  of  time." 

The  vexing  problem  about  the  "youth  unemployment  problem"  is  that 
c  some  groups  of  youths — disproportionately  black  youths — finding  any 
o,  remaining  employed,  and  finding  a  new  job  when  necessary  is  a 
jor  and  continuing  difficulty.  Throughout  this  chapter,  it  has 
some  apparent  that  blacks  suffer  inordinately  from  unem  loyment.  But 


black  unemployment,  inactivity,  etc.,  it  is  not  only  the  black 
population  among  whom  unemployment  is  concentrated.  In  1978  Hispani 
experienced  long-term  unemployment  at  1.3  times  the  rate  of  the 
population  as  whole,  children  from  poverty  families  at  1.6  times  the 
national  rate,  and  those  living  in  inner  cities  at  1.4  times  the 
national  rate  (Congressional  Budget  Office,  1982). 

It  was  against  this  background  that  Congress  enacted  YEDPA  in 
1977.  This  act  instructed  the  Secretary  of  Labor  "to  establish  a 
variety  of  employment  and  training  programs  to  explore  the  methods  o 
dealing  with  the  structural  unemployment  problems  of  the  Nation's 
youth."  In  the  following  chapters  we  review  the  implementation  and 
effects  of  these  programs.  In  Chapter  3  we  describe  the  YEDPA  progr 
and  their  implementation.  In  Chapters  4  through  9  (and  related 
appendixes) ,  we  review  the  effectiveness  of  those  programs  and  the 
scientific  adequacy  of  the  research  which  was  conducted  to  evaluate 
them. 


Implementation  of  the 
Youth  Employment  and 
Demonstration  Projects  Act 


In  July  and  August  of  1977,  under  strong  political  pressure, 
ngress  passed  and  President  Carter  signed  the  Youth  Employment  and 
nonstration  Projects  Act  (YEDPA) .  The  law  (P.L.  95-93) ,  initiated  by 
ngress,  substantially  increased  authorizations  for  two  existing  youth 
ployment  programs  that  were  part  of  the  Comprehensive  Employment  and 
aining  Act  (CETA) ,  the  Job  Corps  and  the  Summer  Youth  Employment 
agram  (SYEP) ,  and  created  four  new  programs,  the  Youth  Community 
servation  and  Improvement  Projects  (YCCIP) ,  the  Youth  Employment  and 
aining  Program  (YETP) ,  the  Young  Adult  Conservation  Corps  (YACC) ,  and 
e  Youth  Incentive  Entitlement  Pilot  Projects  (YIEPP) ,  a  national 
monstration  program  designed  to  encourage  dropouts  to  return  and 
ential  dropouts  to  remain  in  school  using  guaranteed  work  as  an 
zentive. 

The  broad  purpose  of  the  legislation  as  a  whole  was  to  provide 
ployment,  training,  and  demonstration  programs  aimed  at  the  struc- 
ral  unemployment  problems  of  youths.  The  more  specific  purpose  of 
e  demonstration  programs  was  "to  test  the  relative  efficacy  of 
ferent  ways  of  dealing  with  these  problems  in  different  local 
ntexts."  This  charge  was  backed  by  substantial  discretionary 
hority  and  money,  granted  to  the  Secretary  of  Labor  and  delegated  to 
e  Office  of  Youth  Programs,  to  conduct  research,  demonstration,  and 
luation  activities.  In  addition  to  the  substantial  funds  for  YIEPP, 
th  YCCIP  and  YETP  included  discretionary  funds  for  demonstration 
ograms.  This  demonstration  purpose,  however,  was  not  to  preclude  the 
Dvision  of  employment  and  training  programs  aimed  at  the  immediate 
ployment  needs  of  youths. 

Under  YEDPA  annual  outlays  for  youth  programs  were  double  what  they 
3  been  in  previous  years.  In  fiscal  1977,  the  year  before  YEDPA 
gan  operations,  federal  outlays  for  youth  employment  programs  totaled 
55  million  and  served  1.2  million  youths.1  Beginning  in  1978 


hese  were  programs  serving  youths  only.  Additional  expenditures  of 
27  million  served  another  0.8  million  youths  in  adult  programs  under 
_  Comprehensive  Employment  and  Training  Act;  these  programs  continued 
ring  the  YEDPA  years. 
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million  youths.  Although  large  compared  to  previous  efforts,  on  a 
per-participant  basis  annual  expenditures  averaged  only  $1,311. 

Of  the  total  $8  billion,  $628  million  was  spent  for  discretionary 
and  demonstration  projects,  including  both  the  operation  of  the  youth 
programs  (which  accounted  for  most  of  the  expenditures)  and  the 
accompanying  research  and  evaluation  activities.  This  outlay  is  one  of 
the  largest  short-term  investments  in  social  research  and  demonstration 
ever  undertaken  by  the  federal  government.  The  scale  and  complexity  of 
its  research  activities,  imposed  on  a  massive  service  delivery  system, 
created  competing  functions  that  had  major  consequences  for  both  the 
research  effort  and  program  operations.  The  research  program,  designed 
to  provide  a  "knowledge  base  for  improving  youth  employment  policies," 
is  the  basis  of  this  report's  review  of  program  effectiveness. 

This  chapter  provides  a  context  for  interpreting  the  results  of 
YEDPA  programs  and  research  in  terms  of  the  conditions  under  which  the 
act  was  legislated  and  implemented.  This  context  is  considered  in  four 
sections:  the  legislative  background  of  the  act;  the  national  imple¬ 
mentation  of  YEDPA  programs;  the  local  implementation  of  YEDPA  programs 
and  research  activities;  and  the  implementation  of  the  knowledge 
development  research  effort.  This  chapter  relies  heavily  on  the 
background  paper  by  Richard  Elmore,  "Knowledge  Development  under  the 
Youth  Employment  and  Demonstration  Projects  Act"  (in  this  volume)  . 


LEGISLATIVE  BACKGROUND  OF  YEDPA 

Shortly  after  the  inauguration  of  President  Jimmy  Carter  in  1977, 
at  the  instigation  of  several  senior  Senators  of  both  parties,  dis¬ 
cussions  were  held  with  new  administration  appointees  regarding  a  new 
youth  employment  bill,  several  proposals  for  which  had  been  circulating 
in  the  Senate.  With  the  cooperation  of  presidential  appointees  in  the 
Department  of  Labor,  a  joint  Senate-administration  proposal  was  drafted 
and  introduced.  The  proposed  legislation  contained  several  key 
elements,  representing  the  interests  of  its  various  Senate  sponsors:  a 
focus  on  school  dropouts  and  those  at  risk  of  dropping  out  of  school; 
improved  cooperation  between  schools  and  the  employment  and  training 
system;  and  job  training  and  work  opportunities  that  would  prepare 
youths  for  work  in  "the  real  world"  and  provide  them  access  to  jobs. 

Despite  its  involvement  in  the  youth  employment  bill,  the  Carter 
administration's  real  domestic  priority  at  that  time  was  elsewhere,  on 
controlling  inflation  and  rising  unemployment.  To  deal  with  the 
latter,  the  $20  billion  emergency  economic  stimulus  package  that  the 
President  introduced  immediately  after  his  inauguration  created  $8 
billion  in  additional  public  service  jobs  as  part  of  the  CETA  program. 
One  result  of  this  approach  was  to  increase  the  emphasis  in  the 
Employment  and  Training  Administration  (ETA)  of  the  Department  of  Labor 
on  public  employment.  The  burden  of  this  massive  public  jobs  program 
at  the  local  level  and  the  public  image  it  created  of  CETA  were  to 


become  issues  in  both  the  local  operation  of  YEDPA  and  its  reauthor iza- 
tion  as  a  part  of  CETA. 

With  its  attention  elsewhere  and  without  a  specific  youth  proposal 
of  its  own,  the  administration  accepted  the  Senate  version  of  the  youth 
employment  bill.  The  joint  Senate-administration  proposal  requested 
authorization  for  the  establishment  of  three  new  youth  programs,  the 
Young  Adult  Conservation  Corps,  the  Youth  Community  Conservation 
Improvement  Program,  and  the  Youth  Employment  and  Training  Program;  it 
provided  for  joint  projects  by  schools  and  CETA  prime  sponsors;  and  it 
provided  for  a  large  discretionary  budget  (50  percent  of  YETP) ,  as  a 
mechanism  to  adjust  the  formula-funded  allocations  to  the  needs  of 
various  constituencies.  The  House  of  Representatives,  having  been  left 
out  of  the  early  negotiations,  introduced  the  Senate-administration 
bill  and  then  immediately  proceeded  to  write  its  own  alternate  youth 
proposal. 

Common  to  both  Senate  and  House  proposals  was  an  initial  1-year 
authorization.  With  the  entire  CETA  legislation  due  to  expire  in  1978, 
the  plan  was  to  integrate  the  youth  programs  into  CETA  in  a  1978 
reauthorization  bill.  The  House  proposal,  like  the  Senate  one,  also 
included  discretionary  demonstration  activity,  but  as  a  mechanism  to 
learn  what  programs  work  best  and  to  apply  that  knowledge  in  later 
youth  program  legislation. 

The  House  bill's  emphasis  on  research  and  demonstration  was  its 
hallmark,  indicating  uncertainty  about  what  types  of  programs  would 
most  effectively  address  the  problems  of  youth  unemployment  and  a 
commitment  to  research  and  experimentation  as  a  basis  for  future 
program  planning.  One  of  the  purposes  of  the  demonstration  approach 
was  to  prevent  funds  from  being  locked  into  certain  programs  that 
research  might  suggest  were  not  effective.  This  approach  was  in  marked 
contrast  to  the  Senate  proposal,  which  would  more  firmly  establish  new 
youth  programs.  Another  key  difference  between  the  House  and  Senate 
proposals  was  the  House's  Youth  Incentive  Entitlement  Pilot  Project 
(YIEPP) ,  a  program  designed  to  bring  dropouts  back  into  school  and 
prevent  others  from  dropping  out  by  guaranteeing  a  job  on  the  con¬ 
ditions  of  school  and  job  performance. 

Despite  a  lack  of  clarity  about  the  demonstration  programs,  the 
Senate  conceded  to  the  House's  approach.  The  Conference  Report,  which 
stated  the  terms  of  compromise  between  the  House  and  Senate  versions  of 
the  bill,  used  the  House  language  in  stating  that  the  purpose  of  the 
law  was  the  "establishment  of  pilot,  demonstration  and  experimental 
programs  to  test  the  efficacy  of  different  ways  of  dealing  with  the 
problem  of  youth  unemployment;"  however,  the  report  also  stipulated 
that  the  statement  of  purpose  contain  language  "specifying  that  a 
variety  of  employment  and  training  programs,  as  well  as  demonstration 
programs,  are  authorized"  (U.S.  Congress,  1977:35).  Thus,  Congress 
avoided  conflict  between  the  two  fairly  distinct  approaches  by  adopting 
both,  i.e.,  research  and  demonstration  together  with  new  and  large- 
scale  service  programs. 

Several  less  contentious  issues,  representing  the  interests  of  both 
the  Senate  and  the  House,  were  addressed  in  the  compromise  bill: 
increased  cooperation,  through  the  YIEPP  (entitlement  program)  and  a 


joint  CETA-education  set-aside  between  the  CETA  and  educational  systems 
as  a  means  of  addressing  the  dropout  problem?  involvement  of  labor 
organizations  in  youth  programs,  in  particular  in  developing  and 
restructuring  job  classifications,  as  a  means  of  preventing  wage  and 
job  displacement  of  adult  workers  by  youth  programs;  involvement  of 
community-based  organizations  (CBOs)  and  other  local,  state,  and 
nationally  organized  groups  in  the  planning  and  delivery  of  YEDPA 
programs,  as  a  means  of  maintaining  constituency  support  in  the  CETA 
system;  and  involvement  of  other  federal  agencies  in  the  administration 
of  YEDPA  programs  as  a  means  of  coordinating  diverse  federal  activities 
around  the  youth  employment  issue. 

In  its  final  form  the  YEDPA  legislation  was  an  assemblage  of  the 
many  and  somewhat  divergent  congressional  interests  from  which  it 
originated.  It  charged  the  Department  of  Labor  with  two  functions:  to 
conduct  research  and  demonstration  projects  in  coordination  with 
diverse  federal,  state,  and  local  organizations,  in  order  to  find  out 
what  methods  work  best  for  youths;  and,  at  the  same  time,  to  mount 
large-scale  new  programs  to  meet  the  immediate  employment  needs  of 
youths.  YEDPA  provided  substantial  resources  and  discretionary 
authority;  specification  of  whom  to  serve,  but  little  guidance  as  to 
how;  and  a  one-year  time  limit. 


THE  IMPLEMENTATION  OF  YEDPA  NATIONALLY 

Several  conditions  that  characterized  the  CETA  system  during  the 
period  of  YEDPA  implementation  and  early  operations  strained  the 
capability  of  the  system  nationally  and  locally  to  both  administer 
regular  CETA  programs  and  mount  the  new  YEDPA  programs.  These  con¬ 
ditions  also  limited  what  could  reasonably  be  expected  from  YEDPA' s 
rather  ambitious  research  and  demonstration  agenda. 

The  passage  of  YEDPA  in  1977  represented  a  reversal  of  the  control 
of  employment  and  training  programs  granted  to  local  prime  sponsors  4 
years  earlier.  With  the  enactment  of  CETA  in  1973,  Congress  had 
effectively  turned  federal  employment  and  training  programs  over  to 
local  control  by  changing  from  categorical  to  block— grant  funding. 

This  grant  of  authority  to  states  and  localities  was  reinforced  in 
other  federal  programs  as  categorical  programs  were  switched  to  block 
grants.  The  YEDPA  legislation,  with  its  increased  program  requirements 
and  target  group  specifications,  challenged  this  (relatively  new) 
control  of  local  prime  sponsors  over  which  parts  of  the  youth 
population  to  serve  and  how.  It  also  significantly  increased  their 
workload  as  new  reporting  requirements  for  these  programs  were  imposed 
on  a  system  geared  to  different  requirements. 

In  addition  to  the  YEDPA  mandate  to  serve  specific  target  groups  of 
youths,  which  many  considered  a  recategorization  of  youth  services, 
YEDPA  required  that  prime  sponsors  also  maintain  services  to  youth 
participants  in  regular  CETA  programs  at  their  previously  established 
levels.  Many  state  and  local  administrators  perceived  this  effective 
increase  in  services  to  youths  as  disproportionate  when  other  subgroups 
were  also  in  need  of  services.  Although  YEDPA  substantially  increased 
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mrces  at  the  local  level,  it  also  increased  federal  management, 

>ugh  program  and  reporting  requirements,  and  reduced  local  flexibil- 
in  determining  the  allocation  of  services  to  various  target  groups, 
net  effects  at  the  local  level  were  increased  competition  between 
>A  and  regular  CETA  resources  and  a  burdening  of  the  system  as  it 
id  to  manage  two  types  of  programs  with  different  administrative  and 
rating  requirements. 

At  the  same  time  that  YEDPA  was  being  implemented,  CETA  prime  spon- 
>  were  facing  another  new  demand.  As  noted  above,  the  President's 
:gency  economic  stimulus  package  had  substantially  increased  CETA's 
.ic  Service  Employment  (PSE)  Program,  more  than  doubling  the  number 
aublic  service  jobs.  Locally,  the  management  demands  of  PSE  competed 
1  YEDPA  and  regular  CETA  for  limited  staff  time  and  resources. 

Lonally,  PSE  created  an  image  of  CETA  as  a  public  jobs  program, 

:fing  the  less  visible  training  programs,  and  subsequently,  because 
various  reports  of  fraud  and  abuse  in  the  PSE  program,  damaged 
>ort  for  CETA  in  general. 

These  conditions  prevailed  through  the  first  year  of  YEDPA 
ations  and  as  the  1978  CETA  reauthorization  proceedings  began  in 
jress.  At  the  same  time,  the  administration's  focus  on  the  PSE 
[ram  and  welfare  reform  had  effectively  pushed  YEDPA  into  the 
aground  at  the  Department  of  Labor.  It  was  not  until  late  1978, 
ir  the  demise  of  the  Carter  welfare  reform  proposal  and  the  public 
2ries  over  misuse  of  PSE  funds,  that  youth  employment  came  into 
.ic  focus.  Then,  with  YEDPA  already  under  way,  the  President 
ated  the  Vice  President's  Task  Force  on  Youth  Employment,  giving  the 
le  top  domestic  priority  for  the  1980  election.  This  dramatic  shift 
:he  administration's  focus  on  youth  employment  was  to  have  signifi- 
:  effects  on  the  administration  of  YEDPA,  particularly  on  the 
aarch  and  demonstration  activities,  which  were  expected  to  inform 
Vice  President's  Task  Force  in  its  1980  report  to  Congress. 


YEDPA  Expenditures  and  Participation 

YEDPA  mandated  four  new  programs  and  expansion  of  the  two  existing 
^  youth  programs,  the  Job  Corps  and  Summer  Youth  Employment  Program. 
L978,  three  of  the  four  new  programs,  the  Youth  Employment  and 
ning  Programs,  the  Youth  Community  Conservation  and  Improvement 
jects,  and  the  Youth  Incentive  Entitlement  Pilot  Projects  were 
ithorized  as  an  amendment  to  Title  IV  of  CETA,  along  with  the  Job 
ps  and  SYEP.  Under  the  Office  of  Youth  Programs,  which  had  been 
ated  in  the  Employment  and  Training  Administration  to  administer 
:h  programs,  the  Job  Corps  and  SYEP  were  incorporated  in  the  YEDPA 
Drt.  The  Young  Adult  Conservation  Corps,  which  was  reauthorized 
ir  Title  VIII  because  it  was  not  directed  principally  at 
advantaged  youths  and  because  of  its  operation  by  other  federal 
icies,  remained  separate  from  the  larger  YEDPA  effort. 

Each  of  these  youth  programs  represented  a  different  approach  to 
problem  of  youth  employment  and  included  programs  and  services 
Lgned  to  meet  the  needs  of  the  particular  youth  groups.  Table  3.1 
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TABLE  3.2  YEDPA  Expenditures  and  Participants 


Year 

Expenditures 
(in  millions) 

Participants 
(in  thousands) 

1978 

$1,465 

1,558 

1979 

2,048 

1,546 

1980 

2,330 

1,551 

1981 

2,294 

1,389 

Total 

$8,137 

6,043 

SOURCE;  Data  from  U.S.  Department  of  Labor  (1979, 
1980,  1981,  1982). 


describes  the  target  group,  program  approach,  and  administration  of 
each  of  these  youth  programs.  Table  3.2  shows  YEDPA  expenditures  and 
the  number  of  youths  served  from  fiscal  1978  through  the  termination  of 
YEDPA  in  1981.  As  shown  in  Table  3.2,  outlays  increased  substantially 
every  year,  peaking  in  1980,  while  enrollments  were  steady  until  1981 
when  YEDPA  programs  were  being  terminated. 

By  themselves,  the  YEDPA  outlays  and  participant  levels  describe  a 
rise  and  fall  in  activity  level  as  expected  over  the  lifetime  of  a 
program.  When  measured  against  the  CETA  totals  for  the  same  period, 
however,  it  is  apparent  that  over  its  lifetime  YEDPA  accounted  for  an 
increasing  share  of  employment  and  training  activities.  Table  3.3 
compares  federal  outlays  for  all  CETA  titles  with  those  for  YEDPA 
during  the  same  years.  As  total  CETA  expenditures  declined,  YEDPA 
outlays  increased,  from  16  percent  of  the  total  in  1978  to  30  percent 


TABLE  3.3  YEDPA  Expenditures  Compared  With 
Total  CETA  Expenditures 


Year 

CETA 

(billions) 

YEDPA 

Billions 

Percentage 

1978 

$9.5 

$1.5 

16 

1979 

9.4 

2.0 

21 

1980 

8.9 

2.3 

26 

1981 

7.7 

2.3 

30 

SOURCE:  Data  from  U.S.  Department  of  Labor 

(1979,  1980,  1981,  1982). 


TABLE  3.4  Comparison  of  Total  and  Youth 
Participants  in  Employment  and  Training  Programs 


Year 

Participants 

Total 

(millions) 

Youths 

Millions 

Percentage 

1978 

4.3 

2.2 

51.2 

1979 

4.0 

2.5 

62.5 

1980 

3.6 

2.3 

63.9 

1981 

2.9 

2.0 

69.0 

SOURCE ; 

Data  from  U.S. 

Department  of 

Labor 

(1979, 

1980,  1981,  1982) 

• 

in  1981.  Similarly,  YE DP A  participants  accounted  for  an  increas 
share  of  program  participants,  from  37  percent  in  1978  to  48  pei 
1981.  When  the  number  of  youths  served  in  adult-oriented  CETA  \ 
is  added  to  the  totals  for  the  youth-only  programs  (the  four  YE1 
programs.  Job  Corps,  and  the  Summer  Youth  Employment  Program),  1 
percentage  of  employment  and  training  slots  allocated  to  youths 
even  larger.  Table  3.4  compares  the  total  number  of  participant 
(adults  and  youths)  in  all  titles  with  the  total  number  of  youtl 
all  titles.  During  the  YEDPA  period,  the  number  of  youths  as  a 
percentage  of  total  participants  increased  from  51  percent  in  1? 
69  percent  in  1981;  the  majority  of  these  youths,  60-70  percent, 
enrolled  in  YEDPA  programs. 

Tables  3.5  and  3.6  show  expenditure  and  participant  levels, 
respectively,  for  each  of  the  six  youth  programs  for  fiscal  197( 
through  fiscal  1981.  In  the  four  new  YEDPA  programs,  outlays  a: 
doubled  from  1978  to  1979  and  peaked  in  1979  and  1980.  Particij 
in  the  same  programs  increased  more  gradually,  but  also  peaked  : 
and  1980,  except  for  YACC,  which  had  increased  participation  thi 
1981  (even  though  it  had  been  scheduled  in  1980  for  a  1982  term: 
due  to  problems  in  implementation  and  placement)  .  Increased  oul 
for  the  Job  Corps  under  YEDPA  were  aimed  at  doubling  the  enrollr 
fiscal  1978  to  88,000.  This  objective  was  achieved  in  fiscal  ll. 
with  continued  expansion  of  services  through  1981.  The  summer  i 
which  had  served  1  million  youths  in  fiscal  1977  with  additions] 
economic  stimulus  package  funds,  reached  its  all-time  peak  of  me 
1  million  in  1978.  In  the  same  year,  educational  enrichment  of 
summer  program  began,  funded  with  discretionary  money  and  goverr 
grants. 


TABLE  3.5  Outlays  for  Federal  Youth  Employment  Programs, 
Fiscal  1978-1981  (in  millions) 


Fiscal 

Year 

YETP 

YCCIP 

YIEPP 

YACC 

Job  Corps 

SYEP 

1978 

$  294 

$  61 

$  32 

$  719 

$  280 

$  670 

1979 

556 

103 

77 

273 

380 

660 

1980 

695 

122 

88 

234 

470 

721 

1981 

719 

a 

a 

174 

465 

769 

Total 

$2,264 

$410b 

$240b 

$1,400 

$1,595 

$2,820 

Expenditures  for  YCCIP  and  YIEPP  were  reported  jointly  for  1981  at 
$167  million. 

bThe  totals  for  YCCIP  and  YIEPP  assume  that  $43  million  of  the  $167 
million  from  1981  went  to  YIEPP  and  the  remaining  $124  million  to  YCCIP. 
This  assumption  is  based  on  separate  budget  sources  stating  that  total 
outlays  for  YIEPP  for  all  fiscal  years  were  $240  million  (Gueron,  1984) . 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1979,  1980,  1981,  1982). 


Discretionary  and  Demonstration  Projects 

The  Office  of  Youth  Programs  (OYP)  emphasized  research  and 
demonstration  as  an  integral  part  of  YEDPA  program  operations  as  a 
means  of  exploring  various  program  approaches  and  testing  their 
relative  effectiveness.  The  amounts  of  money  to  be  allocated  to  the 
entitlement  demonstration  and  to  other  discretionary  research  and 
demonstration  activity  was  specified  in  rather  complicated  formulas  in 
the  YEDPA  legislation  (Elmore,  in  this  volume).  Based  on  these 
formulas  the  Office  of  Youth  Programs  structured  its  knowledge 
development  plans.  In  fiscal  1978  and  1979,  $437.3  million  was 
allocated  to  discretionary  demonstration  and  research  activities, 
$222.2  million  to  the  entitlement  project,  and  $215.1  million  to  other 
discretionary  projects  (YETP ,  YCCIP,  and  SYEP)  and  research  (U.S. 
Department  of  Labor,  1980a) . 

Although  the  discretionary  projects  emphasized  research  and 
evaluation,  according  to  OYP  most  of  the  discretionary  money  was  spent 
for  the  direct  provision  of  programs  and  services  to  youths  (U.S. 
Department  of  Labor,  1980a) .  In  1979  and  1980,  78  percent  of  the 
discretionary  money  was  for  programs  and  services;  6  percent  was  for 
technical  assistance  and  linkages  to  support  those  programs;  1  percent 
was  for  the  evaluation  of  regular  youth  programs  (i.e.,  Job  Corps  and 
SYEP) ;  7  percent  was  for  the  evaluation  of  the  demonstration  projects; 
and  7  percent  was  for  basic  research  on  youth  employment  problems. 


TABLE  3.6  Participation  in  Federal  Youth  Employment  Programs 
(in  thousands) 


Fiscal 

Year 

YETP 

YCCIP 

YlEPPa 

YACC 

Job  Corps 

SYET 

1978 

359.2 

28.7 

36.8 

51.9 

72.0 

1,0C 

1979 

413.6 

38.5 

53.4 

67.2 

85.0 

8( 

1980 

463.0 

43.0 

50.0 

66.5 

103.8 

8: 

1981 

393.7 

b 

b 

68.0 

114.4 

7: 

Total 

1,629.5 

125.6° 

163.0° 

253.6 

375.2 

3,45 

NOTE:  Participation  is  defined  as  the  total  number  served  in  each  fisc 
year,  not  new  enrollees  served;  figures  include  participants  carried  o\ 
from  the  previous  year. 

aA  total  of  76,000  youths  were  served  in  YIEPP  between  March  1978  and 
August  1980.  Figures  shown  above  include  carry-overs. 

^Participation  for  YCCIP  and  YIEPP  was  reported  jointly  for  1981  at 
38,400. 

c Totals  for  YCCIP  and  YIEPP  assume  that  23,000  of  the  38,400 
participants  enrolled  in  1981  were  enrolled  in  YIEPP,  and  the  remaining 
15,400  in  YCCIP.  The  23,000  figure  is  based  on  Gueron  (1984). 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1979,  1980,  1981,  1982). 

A  1985  accounting  of  actual  expenditures  for  YEDPA  activities 
indicates  that  the  total  for  discretionary  program  operations  and 
research  was  $628  million.  Table  3.7  shows  these  expenditures  bj 
fiscal  year.  Overall,  nearly  15  percent  ($92.2  million)  was  for 
research  activities,  and  85  percent  was  for  program  operations 
(including  technical  assistance);  these  proportions  are  the  same 
those  reported  by  OYP  in  1980. 

In  1978,  when  the  majority  of  discretionary  projects  were 
initiated,  more  than  60  major  demonstrations  were  funded  in  about 
sites.  The  continued  funding  of  these  same  projects  accounted  fc 
majority  of  discretionary  activity  through  the  next  3  years.  YIE 
alone  accounted  for  $240  million  of  the  $628  million  in  discretic 
and  demonstration  expenditures.  In  fiscal  1978  and  1979  the  plan 
budget  for  YETP  demonstrations  totaled  $135  million.  The  major  l 
demonstration  projects  included  an  exemplary  in-school  youth 
demonstration,  several  career  exploration  and  development  project 
planned  variations  of  program  approaches  and  service  mixes,  two  n 
private  sector  projects,  and  a  community  service  project  as  an 
alternative  to  regular  work  experience.  The  YCCIP  budget  plan  fc 
demonstrations  during  the  same  period  totaled  $47  million.  Major 
projects  included  three  conservation  and  community  improvement  pr 
operated  through  various  local  community  organizations,  two  housi 
projects,  and  four  projects  focused  on  improvements  in  railroads, 


TABLE  3.7  YEDPA  Expenditures  for  Discretionary 
Program  Operations  and  Research  by  Fiscal  Year  (in 
millions) 


Fiscal  Year 

Operations 

Research 

Total 

1977-1978 

$  56.456 

$  0.418 

$56,874 

1979 

60.386 

11.323 

71.709 

1980 

84.205 

18.563 

102.768 

1981 

81.198 

46.002 

127.200 

1982 

28.864 

0 

28.864 

YIEPPa 

1978-1981 

$224.3 

$15.9 

$240.2 

Total 

$535,409 

$92,206 

$627,615 

Expenditures  for  YIEPP  provided  by  Gueron  (1984) . 

SOURCE:  Data  provided  by  the  Office  of  Information 
Resources  Management,  Employment  and  Training 
Administration,  U.S.  Department  of  Labor,  April  1985. 


and  agriculture.  Discretionary  funds  were  also  used  for  the  SYEP 
enrichment  projects.  In  1978  and  1979  planned  budgets  for  these 
totaled  $34  million  and  supported  career  orientation  and  educational 
activities  for  summer  youths.2 

Of  the  60  major  demonstrations  initiated  in  1978  and  1979,  22  were 
operated  through  agreements  with  six  other  federal  agencies:  ACTION, 
the  Community  Services  Agency,  the  National  Institute  of  Education,  and 
the  Departments  of  Energy;  Health,  Education,  and  Welfare  (now  Health 
and  Human  Services) ;  and  Housing  and  Urban  Development.  Budgets  for 
these  projects  totaled  $48.8  million  (see  Table  3.8).  The  major 
interagency  agreement  in  terms  of  total  budget  was  YACC,  operated 
jointly  by  the  Departments  of  Interior  and  Agriculture  and  totaling 
$820  million.  Because  of  its  operational  independence  from  the 


2  The  figures  presented  here  are  based  on  the  planned  expenditures  for 
these  activities  as  described  in  the  youth  knowledge  development 
report,  Knowledge  Development  Activities  for  Fiscal  Years  1978  and  1979 
(U.S.  Department  of  Labor,  1980)  .  With  the  exception  of  YIEPP  and 
total  fiscal  year  expenditures  as  presented  in  Table  3.7,  a  precise 
accounting  of  actual  expenditures  for  individual  discretionary  projects 
is  not  available. 


TABLE  3.8  Knowledge  Development  Activities  With  Other  Organizations 
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Demonstration  Research  Corporation  (MDRC) ,  an  established  corporation 
with  previous  experience  in  demonstration  efforts ,  managed  the  YIEPP. 


LOCAL  IMPLEMENTATION  OF  YEDPA 

YEDPA  discretionary  activities,  both  the  programs  and  their 
accompanying  research,  were  planned  and  managed  by  the  Office  of  Youth 
Programs  and  implemented  through  the  local  CETA  prime  sponsor  network. 
The  knowledge  development  agenda  (described  in  the  next  section)  was 
supposed  to  provide  the  structure  for  a  coordinated,  coherent  plan  of 
program  and  research  activities.  OYP's  plan  was  to  distribute  the 
funds  and  implement  the  programs  through  the  CETA  system  and  then  to 
manage  and  shape  that  system  through  research  and  evaluation.  Thus,  it 
was  at  the  local  level  that  the  duality  of  YEDPA  program  operations  and 
research  had  to  be  combined  successfully  to  meet  YEDPA 8 s  goals. 

The  first  section  of  this  chapter  noted  the  constraints  of  this 
dual  operations  and  research  endeavor,  exacerbated  by  the  demands  of 
regular  CETA  operations  and  the  increased  Public  Service  Employment 
program.  This  section  describes  in  more  detail  the  effects  of  this 
duality  at  the  local  level  and  the  costs  it  may  have  imposed  in  terms 
of  the  ultimate  effectiveness  of  YEDPA  programs. 

The  local  implementation  of  YEDPA  programs  is  discussed  in  terms  of 
five  basic  tasks?  (1)  planning  and  assembling  programs;  (2)  targeting, 
recruiting,  and  enrolling  participants;  (3)  staffing  and  organizing 
program  activities;  (4)  assessing  participant  needs  and  matching  them 
to  program  services;  and  (5)  monitoring  quality  of  programs  and 
services.  This  discussion  is  based  on  reports  on  the  implementation  of 
several  demonstration  projects,  case  studies  of  implementation  of 
formula- funded  YEDPA  programs,  and  reports  on  program  impact  that 
highlighted  implementation  issues.  Although  some  of  the  projects 
discussed  here  also  appear  in  the  reviews  of  program  effectiveness, 
many,  due  to  the  nature  of  the  implementation  problems,  were  excluded 
from  those  reviews  (see  Appendix  B  for  the  list  of  reports  included  in 
the  implementation  and  effectiveness  reviews) .  Since  these  data  were 
not  systematically  collected,  we  do  not  know  how  representative  they 
are  of  YEDPA  programs  and  demonstration  activities.  Hence,  this 
discussion  is  presented  here  as  an  indication  of  the  general  nature  and 


Task  Is  Planning  and  Assembling  Programs 

YEDPA,  with  a  1-year  authorization,  congressionally  mandated 
features,  and  significant  increases  in  level  of  program  funding, 
inordinate  pressure  on  the  planning  and  implementation  of  program 
the  local  level.  The  process  of  designing  and  communicating  the 
regulations  and  budgets  from  Washington  to  the  local  level  was  si 
uncertain;  the  information  needed  for  planning  was  often  late  get 
to  prime  sponsors  and  shortened  the  time  available  for  planning  a 
assembling  programs. 

Uncertainties  in  regulations  and  budgets  were  common.  Some  Y 
innovations  depended  on  the  waiver  of  established  CETA  regulation 
The  placement  of  youths  in  work  positions  in  private  for-profit  f 
for  instance,  was  prohibited  by  CETA  regulation,  but  encouraged  u 
YEDPA.  To  waive  this  regulation,  however,  each  prime  sponsor  had 
apply  for  permission  to  the  national  office.  The  approval  proces 
complicated  local  planning  and  discouraged  some  prime  sponsors  fr 
use  of  this  option. 

Even  after  the  first  year,  budget  delays  and  uncertainties 
threatened  program  operations  with  the  end  of  almost  every  federa 
fiscal  year.  For  example,  the  Employment  and  Training  Administra 
announcement  at  the  end  of  fiscal  1979  that  no  funds  could  be  exp 
in  the  new  fiscal  year  pending  congressional  authorizations  creat 
havoc  with  local  prime  sponsors,  who  were  forced  to  negotiate  int 
contracts,  budget  extensions,  and  make-shift  arrangements  with  th 
local  program  operators  to  prevent  program  termination. 

YEDPA  broadened  the  base  of  local  organizations  involved  in  p 
and  operating  youth  programs  with  its  requirements  to  involve  com 
based  organizations,  the  schools,  unions,  and  private  employers, 
gain  cooperation  and  thereby  ease  implementation  and  operation,  p 
operators  tried  to  involve  all  of  the  major  parties  in  the  planni 
stage.  It  was  assumed  that  such  involvement  in  planning  would  ex 
and  ease  the  flow  of  resources  throughout  the  local  service  syste 
Planning  by  consensus,  however,  complicates  the  decision-making  p 
and  can  undermine  efforts  to  change  the  direction  or  nature  of  th 
service  delivery  system;  yet  such  change  may  be  desired  when  the 
existing  system  does  not  address  important  aspects  of  the  problem 
the  Career  Intern  Program,  for  instance,  a  program  fraught  with  s 
implementation  problems,  there  were  seven  parties  to  each  program 
decision:  the  Department  of  Labor,  the  National  Institute  of  Edu 
the  national  and  local  offices  of  the  Opportunities  Industrialize 
Center  (OIC) ,  the  school  system,  the  prime  sponsor,  and  the  progr 
evaluator . 

The  involvement  of  the  school  systems  in  planning  and  operati 
youth  programs  was  considered  an  important  link  in  local  youth  ne 
The  YEDPA  legislation  mandated  that  22  percent  of  YETP  funds,  the 
largest  formula-funded  program,  be  spent  in  negotiated  agreements 


:he  schools.  The  entitlement  program  (YIEPP)  also  required  close 
elations  with  the  schools  since  satisfactory  school  attendance  and 
lerformance  was  a  condition  of  the  job  guarantee.  In  addition,  several 
lemonstration  projects  required  agreements  with  schools  in  running 
lternative  education  and  school- to-work  transition  projects.  And,  of 
lourse,  schools  were  also  an  important  source  for  the  recruitment  of 
ligible  in-school  youths  for  various  programs. 

The  results  of  experiences  with  schools  confirm  in  general  the 
tatus  quo  thesis  suggested  above:  although  the  22  percent  mandate  did 
incourage  the  schools  to  collaborate  with  CETA,  it  did  not  change 
ither  the  nature  of  the  services  provided  by  the  educational  system  or 
he  youths  whom  it  served.  The  schools,  although  they  did  provide 
ccess  to  certain  youth  groups,  maintained  their  focus  on  in-school 
ouths  and  provided  essentially  the  same  set  of  educational  services  as 
sual.  The  lack  of  influence  of  YEDPA  (or  CETA)  on  schools  may  be 
ttributed  largely  to  the  schools"  resistance  to  allocating  services 
ccording  to  income  and  to  a  basic  difference  in  their  perception  of 
heir  mission  and  constituency.  In  addition,  schools,  although  they 
enefit  from  CETA  funds,  are  not  dependent  on  them  for  their  existence 
nd  therefore  are  not  as  willing  as  other  organizations  to  adapt  to 
ETA's  short-term  and  unsteady  funding  cycles. 

Results  of  collaboration  with  CBOs,  also  mandated  by  YEDPA,  were 
imilar  to  those  with  schools.  Although  the  CBOs  were  more  dependent 
>n  these  funds  than  schools  and  therefore  more  amenable  to  YEDPA' s 
pproach,  it  was  difficult  to  effect  changes  in  their  approach  and  in 
he  target  groups  traditionally  served  by  some  CBOs,  each  of  which  had 
ts  own  constituency.  Moreover,  because  of  their  dependence  on  unsteady 
unding  sources,  many  CBOs  had  difficulty  in  recruiting  and  retaining 
ualified  staff. 

The  involvement  of  unions  and  private  employers  in  planning  and 
rogram  assembly  was  limited.  The  requirement  that  unions  review  prime 
ponsor  plans  assured  compliance  with  the  Davis-Bacon  Act  and  ensured 
hat  union  jobs  would  not  be  undercut  by  YEDPA  subsidies  to  youths, 
ome  agreements  were  negotiated  for  union  involvement  in  work-training 
emonstration  projects.  Although  private  employers  were  not  actively 
nvolved  in  program  planning,  they  did  participate  in  some  work  experi- 
nce  projects,  notably  the  entitlement  program  and  the  Public  Versus 
rivate  Sector  Jobs  Demonstration.  The  effect  of  union  and  private 
usiness  participation  in  program  operations  is  discussed  in  Task  3. 

In  general,  a  tradeoff  was  made  at  the  planning  and  assembly  stage 
which  continued  throughout  operation  of  the  programs) :  a  tradeoff 
etween  smoothness  of  implementation  and  changing  the  direction  of 
ervices  and  opportunities.  What  was  done  most  often  was  to  expand  the 
xisting  set  of  opportunities  by  involving  the  major  participants  in 
he  community  service  network.  This  strategy  avoided  the  pitfalls  of 
iypassing  existing  organizations  and  creating  resistance  that  could 
tall  implementation,  but  at  the  cost  of  reform  or  change  in  the  type 
>f  opportunities  available. 

Case  study  reports  of  the  implementation  of  formula-funded  programs 
YETP,  YCCIP,  and  SYEP)  (National  Council  on  Employment  Policy,  1980a, 
980b,  1980c,  1980d)  and  of  the  entitlement  program  provide  more  detail 
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on  the  effects  of  these  conditions  on  YEDPA  planning  and  program 
assembly  in  terms  of  the  planning  of  program  services,  the  selection  c 
program  operators ,  the  assessment  of  participant  needs,  the  hiring  anc 
training  of  staff,  the  creation  of  reporting  and  information  systems, 
and,  not  least  of  all,  the  ability  or  willingness  of  the  pr ime  sponsor 
to  cooperate  with  any  additional  research  requirements  of  the  knowledc 
development  plan. 


Task  2:  Targeting,  Recruiting,  and  Enrolling  Participants 

The  target  group  for  YEDPA  programs  was  defined  broadly  as  eco¬ 
nomically  disadvantaged  youths.  For  each  part  of  YEDPA,  the  def initic 
was  more  specific  in  terms  of  age,  employment  and  school  status ,  and 
the  Bureau  of  Labor  Statistics'  living  standard  (see  Table  3.1)  .  in 
some  parts,  the  entitlement  program  (YIEPP) ,  for  example,  eligibility 
criteria  were  stricter  than  in  other  parts  or  titles.  Within  the 
legislated  target-group  definitions,  local  prime  sponsors  were  asked  t 
identify  "significant  segments"  of  particularly  disadvantaged  youths 
for  more  emphasis. 

Two  factors  constrained  the  targeting  and  recruiting  of  youths  for 
YEDPA  programs .  First,  because  of  the  short  planning  period  for  YEDPA 
many  prime  sponsors  based  their  target-group  designations  (i.e.,  size 
and  characteristics  of  population)  on  information  that  was  out  of 
date.  In  addition,  to  ensure  adequate  funding  in  the  event  of  a  great 
demand  for  the  program,  some  prime  sponsors  tended  to  overestimate 
enrollments .  The  result  was  that  actual  enrollments  were  often  less 
than  planned  enrollments. 

Second ,  because  of  YEDPA' s  maintenance-of-ef fort  requirement  (that 
regular  services  to  youths  in  other  titles  not  be  curtailed  because  of 
the  availability  of  YEDPA  funds)  ,  many  prime  sponsors  reported  diffi¬ 
culty  in  recruiting  the  required  numbers  of  youths  for  some  YEDPA 
demonstration  projects  (e.g. ,  the  Career  Intern  Program,  the  Mixed 
Income  Experiment,  the  Bureau  of  Apprenticeship  Training  Project, 

Oppor tunities  to  Learn  and  Earn ,  and  Job  Factory)  .  This  problem  was 
sometimes  most  pronounced  in  programs  targeted  to  the  most  disadvan¬ 
taged.  These  factors ,  together  with  a  perceived  discrepancy  between 
the  demands  of  the  labor  market  and  the  characteristics  of  the  youths 
served,  gave  rise  to  a  tradeoff  between  serving  those  most  in  need  in 
target  group  (i.e. ,  the  most  disadvantaged  of  in-school  or  out-of- 
school  youths)  and  serving  those  whom  it  was  thought  could  get  the 
greatest  benefit  from  the  program  (usually  the  least  disadvantaged) . 

The  involvement  of  pr ivate  employers  in  youth  programs  was  an 
additional  impetus  for  many  program  operators  to  select  the  relatively 
less  disadvantaged  because  they  were  thought  to  be  more  capable  and 
attractive  to  employers .  This  practice  of  "creaming "  raises  questions 
of  equity  and  efficiency  if  one  assumes  that  many  of  these  relatively 
less  disadvantaged  youths  would  have  obtained  jobs  without  the  aid  of 
the  programs. 


The  Role  of  Schools 


The  recruitment  of  in-school  youths,  particularly  when  recruiting 
or  program  operations  involved  the  cooperation  of  the  school  system, 
was  especially  subject  to  creaming.  Some  school  officials  reportedly 
viewed  program  participation  as  a  reward  for  the  most  promising  among 
low- income  youths.  The  identification  of  a  particularly  impor tant 
in-school  group — those  "at  risk"  of  dropping  out  of  school — for 
instance ,  was  subject  to  wide  interpretation.  Case  studies  indicate 
that  although  a  few  schools  turned  to  school  records  as  a  means  of 
identifying  potential  dropouts ,  many  schools  identified  such  youths 
through  less  objective  means .  Depending  on  how  youths  "at  risk"  were 
identified,  the  target  groups  served  in  different  areas  may  have  been 
quite  different  from  each  other . 

The  recruitment  of  school  dropouts ,  as  distinct  from  those  at  risk 
of  dropping  out,  presented  even  more  of  a  problem  for  local  program 
operators .  Most  schools,  because  they  were  not  actively  involved  with 
dropouts ,  found  it  difficult  to  recruit  them,  and ,  if  they  recruited 
them,  found  it  difficult  to  adjust  their  programs  to  accommodate  them. 
The  entitlement  program,  for  example ,  which  was  designed  to  serve 
dropouts  willing  to  return  to  school  as  well  as  in-school  youths,  ended 
up  serving  primarily  in-school  youths  thought  to  be  at  risk  of  dropping 
out.  The  difficulty  the  entitlement  program  encountered  in  keeping 
returned  dropouts  in  school ,  even  with  a  job  guarantee ,  suggests  the 
great  difficulty  of  providing  educational  services  for  this  group.  It 
is  not  clear  from  the  available  reports  whether  schools  resisted 
targeting  and  service  to  dropouts  s imply  because  they  saw  their  mission 
and  constituency  as  different  from  CETA's  or  because  the  requirements 
of  recruiting  and  serving  such  youths  were  too  burdensome. 

The  patterns  of  participation  of  in-school  compared  with  out-of¬ 
school  youths  were  also  a  function  of  the  type  of  program  offered. 

YETP ,  although  targeted  to  both  in-school  and  out-of-school  youths , 
enrolled  pr imar ily  in-school  youths ,  and  as  suggested  above ,  not 
necessarily  the  most  disadvantaged  youths .  On  the  other  hand,  YCCIP 
which  was  targeted  to  out-of-school ,  unemployed  youths,  enrolled 
primarily  high  school  dropouts  who  were  more  economically  disadvantaged 
than  YETP  participants.  The  image  of  YCCIP  as  an  unadorned  work 
experience  program  of  low-skill  level  may  account  for  this .  It  is  also 
interesting  that  despite  the  traditionally  male  jobs  developed  in  YCCIP 
(e.g. ,  weather ization ,  maintenance ,  rehabilitation ,  and  landscaping) , 

25  percent  of  the  participants  were  female . 


The  Role  of  Other  Agencies 

The  high  participation  rates  of  in-school  youths  in  YEDPA  programs 
in  part  reflects  the  chronic  problem  of  recruiting  out-of -school 
youths,  particularly  dropouts.  Many  prime  sponsors  have  relied  on 
employment  security  offices  and  certain  CBOs  to  recruit  dropouts  for 


ment,  they  have  had  difficulties  in  actually  enrolling  and  then  ser 
dropouts.  Many  CBOs,  by  tradition,  have  provided  specialized  servi 
(e.g. ,  skills  training,  career  exploration,  and  basic  education)  fo 
certain  target  groups  (e.g. ,  women ,  refugees,  and  ethnic  minorities 
and  were  used  in  reaching  those  target  populations .  Like  the  schoo 
however,  the  goals  of  the  CBOs  at  times  diverged  from  those  of  the 
YEDPA  programs ,  causing  similar  implementation  problems .  The  CBO-r 
Career  Intern  Program,  for  instance,  found  few  dropouts  willing  to 
participate  in  their  alternative  education  program;  many  youths 
indicating  their  preference  for  a  faster  Graduate  Equivalency  Diplo 
(GED)  program. 

The  involvement  of  other  federal  agencies  in  youth  employment, 
mandated  by  YEDPA ,  did  not  occur  at  the  local  level  to  the  same  deg: 
that  collaboration  with  schools  and  CBOs  did.  With  the  exception  o 
demonstration  projects  funded  under  interagency  agreements ,  about  wl 
little  is  known  due  to  lack  of  evaluations  of  program  impact,  there 
were  only  scattered  examples  of  efforts  to  involve  other  units  of  1< 
government  (e.g. ,  welfare  and  juvenile  service  agencies)  in  youth 
programs. 

The  role  of  another  part  of  the  Department  of  Labor ,  the  Employ 
Service ,  for  instance ,  was  limited .  With  the  exception  of  Project 
STEADY,  which  was  designed  and  operated  by  the  Employment  Service  t 
provide  assessment  services  to  youths ,  the  local  offices  did  little 
more  than  refer  job  seekers  to  CETA  programs  and  verify  the  eligibi 
of  CETA  applicants.  The  Employment  Service  has  traditionally  been 
v iewed  as  a  means  of  recruiting  out-of-school  youths ,  but  its  role 
overall  effectiveness  in  providing  this  service  for  YEDPA  is  not  kn< 

The  repeated  failures  of  programs  to  reach  the  dropout  populate 
explains  the  general  tendency  of  programs  designed  to  serve  dropout! 
redirect  their  efforts  to  more  easily  recruited  in-school  youths 
identified  as  potential  dropouts .  Although  this  approach  may  prevei 
some  youths  from  dropping  out,  it  does  not  address  the  needs  of  tho 
who  already  have .  The  emphasis  on  in-school  youths  also  fits  the 
historical  trend  of  employment  and  training  programs  to  serve  this  : 
reachable  target  group  and  to  or  ient  its  programs  to  them . 


The  Economic  and  Racial  Isolation  of  Youth  Employment  Programs 

Another  problem  faced  by  prime  sponsors  in  the  recruitment  of  Y1 
participants  was  the  strict  income  eligibility  requirement  and  the 
image  it  created  of  YEDPA  as  a  poverty  program,  and  by  association  : 
many  urban  areas,  a  black  program.  One  consequence,  particularly  i: 
areas  wher e  school  integration  had  created  friction ,  was  the  dif f ici 
of  recruiting  white  youths. 

The  participation  patterns  in  the  entitlement  program  illustrat 


he  influence  of  several  other  factors  on  program  participation  and 
einforce  the  findings  of  other  YEDPA  programs  that  participation  is 
igher  among  in-school  than  out-of-school  youths  and  higher  among 
lacks  and  Hispanics  than  among  whites.  These  patterns  appear  to  be 
nfluenced  by  the  job  and  program  alternatives  available  to  those 
ouths,  the  amount  and  type  of  recruitment,  and  the  image  of  the 
rograms  in  those  communities . 

The  higher  participation  of  blacks  than  Hispanics  in  part  reflects 
he  alternatives  available  to  these  two  groups  in  their  local  com- 
lunities.  In  the  entitlement  program  areas,  eligible  Hispanics  had 
igher  employment  rates  and  lower  school  enrollment  rates  than  did 
lacks;  in-school  blacks,  who  had  fewer  employment  opportunities, 
ended  to  enroll  in  the  entitlement  program,  while  out-of-school 
[ispanics  had  more  alternatives  for  employment  outside  the  program. 

The  low  participation  of  white  youths ,  and  the  difficulty  of  some 
•rograms  in  recruiting  them,  is  a  function  of  the  coincidence  of  race 
nd  eligibility  criteria.  The  fact  that  the  entitlement  program  had 
tricter  income  eligibility  requirements  (i.e. ,  generally  required 
ower  family  income )  than  other  YEDPA  programs  resulted  in  a  large 
:oncentration  of  minorities  in  the  eligible  population.  In  addition, 
n  those  sites  where  the  entire  city  was  not  the  focus  of  the 
intitlement  program,  existing  residential  segregation  combined  with  the 
equirement  of  residency  in  the  entitlement  area  to  increase  the 
linor ity  racial  and  ethnic  character  of  the  eligible  pool. 

Thus ,  even  if  the  programs  were  as  attractive  to  white  as  to  black 
•r  Hispanic  youths,  the  latter  groups  would  have  represented  a 
ubstantial  share  of  participants  in  many  areas  and  a  majority  in  some 
e .g . ,  Baltimore  and  Detroit) .  These  situations  were  exacerbated  by 
he  image  of  these  programs  as  black  poverty  programs .  Attempts  to 
:est  the  effects  on  these  programs  of  economic  isolation  by  mixing 
•articipants  of  various  income  levels ,  as  in  the  Mixed  Income 
>emonstration,  were  frustrated  by  difficulties  in  recruiting  sufficient 
lumbers  of  nond i sadvan tag e d  youths . 

In  summary,  several  general  points  emerge  from  the  evidence  on 
.argeting  and  recruitment.  First,  the  criterion  of  economic  disad- 
rantage  is  increasingly  difficult  to  implement  at  the  increasingly 
lisadvantaged  levels.  Second ,  many  of  these  programs  tend  to  recruit 
md  enroll  more  in-school  than  out-of-school ,  particularly  dropout, 
ouths ,  partly  because  dropouts  are  outside  the  established  education 
ind  social  service  network  and  therefore  are  difficult  to  reach ,  and 
>artly  because  many  youth  program  operators  have  historically  geared 
:heir  services  to  in-school  youths  and  resist  adjusting  to  other 
i roups .  Those  programs  that  did  enroll  large  numbers  of  dropouts 
[enerally  experienced  higher  turnover  of  participants  and  underspent 
.heir  funds ,  indicating  that  a  workable  approach  to  serving  the  dropout 
>opulation  had  not  been  found.  Third,  it  appears  that  targeting 
>rograms  to  economically  disadvantaged  youths  tends  to  isolate  those 
>rograms  socially,  racially,  and  economically,  perhaps  limiting  their 
iffectiveness. 


Task  3:  Staffing  and  Organizing  Program  Activities 


Staffing 

The  quality  and  stability  of  program  staff  are  important  facte 
the  operation  of  youth  programs .  Numerous  program  evaluations  cit 
staff  characteristics  as  contributing  to  program  success  and  progr 
failure.  Although  quantitative  data  are  not  abundant ,  conventions 
wisdom  and  the  observations  of  program  personnel  and  evaluators  a] 
suggest  the  important  role  played  by  the  staff  in  programs  in  whic 
personal  motivation  and  morale  are  critical  to  participants '  succe 
The  summer  program  is  an  example  of  improvement  in  program  quality 
the  quality  of  the  work-site  supervision  is  enhanced. 

The  staffing  of  youth  programs  has  been  constrained  by  the  ins 
ity  of  funding  and  the  isolation  of  the  programs  from  mainstream  s 
institutions .  Staff  positions  in  employment  and  training  programs 
characteristically  been  low  paying  and  offer  limited  opportunity  f 
advancement .  Given  such  conditions,  it  has  been  difficult  to  recr 
and  retain  quality  staff.  These  characteristics ,  plus  the  limited 
duration  of  many  youth  projects,  have  created  high  turnover  in  bot 
prime  sponsor  and  program  operator  staff,  which  in  turn  create  a 
program  environment  of  discontinuity  and  impermanence .  Several  cs 
studies  cite  staff  turnover  in  excess  of  50  percent  and  others  not 
complete  turnover  of  top  administrative  staff  (Taggart,  1980)  . 


Program  Activities 

The  formula-funded  programs  operated  under  YEDPA,  YETP,  and  YC 
were  organized  and  implemented  much  as  they  had  been  under  regular 
youth  programs.  The  time  pressure  under  which  programs  were  starl 
and  the  YEDPA  requirement  that  funds  be  given  to  programs  with 
"demonstrated  effectiveness"  reinforced  prime  sponsors '  reliance  c 
established  programs  and  providers ,  a  reliance  that  case  study  rej 
suggest  was  warranted  (National  Council  on  Employment  Policy,  198( 
1980c) .  Other ,  more  basic  problems  with  these  program  operations , 
however ,  included  the  restriction  of  work  activities  imposed  by  tt 
Davis -Bacon  Act.  This  law,  written  to  prevent  the  displacement  oi 
unionized  workers  by  nonunion  workers,  requires  that  construction 
workers  employed  under  federally  funded  projects  be  paid  union  wac 
rates  even  if  they  are  not  union  members .  This  provision  effectix 
limited  the  activities  allowed  in  work  programs,  sometimes  adverse 
affecting  their  quality. 

Restrictions  on  the  allowable  use  of  employment  and  training  i 
created  another  limitation.  YCCIP  projects ,  for  instance,  were  si 
to  employ  youths  in  community  improvement  and  conservation  projecl 
but  there  were  no  funds  for  supplies  or  equipment  so  programs  had 
obtain  supplemental  funds  from  other  local  sources .  Placement  of 
in  pr ivate  businesses  was  not  to  involve  any  work  that  would  conti 
to  the  profit  of  the  firm,  which  made  it  difficult  to  provide  youl 
with  meaningful  work .  The  requirement  that  YACC  projects  not  coni 


91 


tasks  that  the  federal  agency  would  have  done  at  its  own  expense 
nt  that  those  tasks  were,  like  the  tasks  in  private  businesses,  of 
priority.  These  requirements  presented  challenges  that  were  met 
h  varying  degrees  of  success. 

Some  of  the  demonstration  projects  provide  examples  of  the  effects 
restrictions  on  program  operations.  In  one  YCCIP  demonstration 
ject.  Ventures  in  Community  Improvement  (VICI) ,  funds  for  supplies 
equipment  were  obtained  from  local  sources ,  with  such  success  that 
e  of  the  eight  VICI  sites  continued  operations  with  local  support 
er  YEDPA  funds  were  gone .  A  study  of  the  involvement  of  private 
iness  in  the  entitlement  program  (YIEPP)  found  that  the  higher  the 
lity  of  work ,  the  higher  the  displacement  of  nonsubsidized  workers , 
gesting  the  inconsistency  between  the  provision  that  jobs  not  be 
-work  and  the  Davis -Bacon  no-displacement  requirement. 

The  involvement  of  private  businesses  in  youth  programs  met  with 
ed  success .  The  entitlement  program  (YIEPP)  recruited  nearly  6,000 
inesses  as  work  sponsors,  representing  55  percent  of  all  work  spon- 
s  (public  and  private)  participating  and  20  percent  of  youth  job 
rs.  However ,  even  when  offered  a  full  subsidy  at  the  minimum  wage 
relieved  of  overhead  costs ,  only  18  percent  of  the  employers 
pled  in  a  survey  of  private  businesses  (Ball  et  al. ,  1981)  would 
ee  to  accept  an  entitlement  program  youth .  At  a  75  percent  wage 
sidy,  the  agree-to-participate  rate  dropped  to  10  percent,  and  at  a 
ercent  subsidy  it  dropped  to  5  percent.  On  the  whole ,  however ,  the 
loyers  in  the  entitlement  program  reported  satisfaction  with  the 
ths  placed  with  them,  and  one  in  five  hired  that  person  after  the 
sidy  ended.  The  Corporate  Career  Demonstration  Project,  on  the 
er  hand,  which  was  to  train  youths  in  corporate  careers  through 
cement  in  entry-level  positions  in  participating  businesses,  could 
recruit  youths  of  the  appropriate  skill  level  for  the  program.  The 
vate  employers  were  unwilling  to  participate  when  the  participants ' 
k  of  basic  skills  became  apparent. 


Task  4 :  Assessing  Participant  Needs 
and  Matching  Them  to  Program  Services 

There  are  two  basic  ways  of  assessing  needs  and  prescribing 
ices  for  youths :  according  to  their  membership  in  broadly  defined 
ups  or  as  particular  individuals.  The  first  method  considers  such 
racteristics  as  age ,  school  status,  or  family  status  (e.g . , 
herhood) .  These  categories  may  then  be  connected  to  broad 
egories  of  program  components  suited  in'  general  to  members  of  the 
up — providing  skills  training,  for  example,  to  groups  of  older 
ths,  with  or  without  particular  services ,  such  as  child  care, 
tinctions  among  these  groups  of  people  can  be  made  on  the  basis  of 
ective  characteristics  and  appropriate  assignment  can  be  made 
tinely.  This  was  perhaps  the  predominant  method  of  assessing  needs 
YEDPA,  particularly  in  the  formula-funded  programs .  The  second 
hod,  based  on  individual  needs ,  considers  such  issues  as  educational 
iciencies,  career  aptitudes  and  interests ,  and  social ,  family,  or 


needs  were  assessed  prior  to  recruitment  and  enrollment  of  parti 
Individual  needs  assessment,  when  available,  was  provided  after 
ment  and  usually  by  a  smaller  program  operator  subcontracted  for 
service.  There  is  little  evidence  that  prime  sponsors  designed 
to  meet  the  individually  assessed  needs  of  participants ,  probabi 
because  initial  funding  decisions  tended  to  lock  in  specific  ser 
prior  to  such  assessments.  It  was  possible,  however ,  to  use  inc 
needs  assessments  to  assign  participants  to  available  program  ar 
service  options . 

Under  YEDPA  the  assessment  of  individual  participant  needs  v 
generally  restricted  to  demonstration  programs,  there  being  litt 
provision  for  such  services  in  formula-funded  programs .  Some  of 
Project  STEADY  sites,  Project  Redirection,  and  the  Consolidated 
Employment  Demonstration  Project  are  examples  of  YEDPA  demonstre 
projects  that  offered  such  services.  In  these  cases  the  indivic 
assessments  took  the  form  of  " employab i 1 i ty  development  plans"  a 
prescriptions  for  various  programs  and  support  services  tailored 
individual.  One  source  reports  that  in  the  Consolidated  Youth 
Employment  Project  the  more  complete  assessment  practices  did  nc 
affect  how  services  were  provided  or  who  was  given  what  services 
and  Lerman,  1983). 

There  is  a  general  lack  of  evidence  as  to  the  effectiveness 
individual  needs  assessment  in  terms  of  participant  outcomes.  E 
in-school  youths,  individual  needs  are  probably  most  closely  re] 
their  educational  situation  and  best  handled  by  the  schools  then 
Attempts  at  assessing  individual  career  interests  of  in-school  y 
for  the  purpose  of  placement  in  work  experience,  for  instance,  i 
probably  premature  for  this  age  group  (Osterman,  1980b)  ,  and  it 
costly  to  operate  beyond  a  limited  scale . 

For  out-of-school  youths,  however ,  individual  assessments  oi 
tional  and  employment  needs  appear  to  be  more  important  and  pote 
have  more  payoff.  With  the  exception  of  the  Job  Corps,  however , 
were  no  major  efforts  under  YEDPA  to  provide  such  individual  ser 
YCCIP,  for  instance,  which  served  largely  out-of-school  youths, 
unadorned  work  program  with  no  provision  for  such  extra  services 


Task  5:  Monitoring  Quality  of  Programs  and  Services 

The  Department  of  Labor  continually  exhorted  prime  sponsors 
attentive  to  the  quality  of  programs,  in  particular  as  indicated 
project  size  and  number  of  supervisors .  Case  study  reports  of  t 
formula-funded  programs  (National  Council  on  Employment  Policy, 
1980c)  suggest  that  the  overall  quality  of  work  experience  under 
was  better  than  it  had  been  in  earlier  youth  programs.  Evaluati 
the  entitlement  program  also  indicated  that  the  quality  of  work 
ences  in  the  opinion  of  evaluators,  supervisors,  and  participant 
generally  good. 
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This  general  improvement  in  work  quality  during  YEDPA  in  comparison 
th  earlier  CETA  programs  was  due  largely  to  a  1979  report  (U.S. 
leral  Accounting  Office ,  1979)  on  the  summer  youth  program  and  the 
:ensive  monitoring  of  programs  that  followed.  The  report  cited 
nerous  problems  in  the  summer  program,  notably  the  poor  quality  of 
pervision,  the  meaningless  make-work  jobs  to  which  the  youths  were 
signed,  and  the  failure  of  work  site  supervisors  to  require  attendance 
a  condition  of  payment.  The  public  outcries  caused  by  this  report 
xnpted  the  creation  of  an  extensive  monitoring  system  involving 
:ional  and  regional  offices,  prime  sponsors  and  program  operators, 

1  the  establishment  of  standards  for  work  site  supervision,  quality 
work  assignment,  and  time  and  attendance  procedures . 

The  sustained  pressure  from  the  national  office  on  local  programs 
establish  and  enforce  standards  of  quality  in  program  operations  and 
i  capacity  for  self-evaluation  that  it  created  were  important 
itributions  to  the  youth  employment  and  training  system. 


YEDPA  RESEARCH:  THE  YOUTH  KNOWLEDGE  DEVELOPMENT  PLAN 

The  YEDPA  research  agenda,  known  as  the  youth  knowledge  development 
in,  was  designed  and  administered  by  the  national  Office  of  Youth 
jgrams  and  implemented  through  agreements  with  local  CETA  prime 
>nsors  and  contracts  with  various  public  and  private  research  agents 
1  "intermediaries. n  This  effort  consisted  of  various  demonstration 
)jects  and  of  research  and  evaluation  studies  of  them  and  of  some 
:mula-funded  programs . 

Two  major  factors  constrained  the  design  and  conduct  of  YEDPA 
search  activities :  first,  the  competing  demand ,  both  nationally  and 
:ally,  to  mount  four  new  youth  programs,  at  roughly  double  the  level 
previous  funding ,  within  the  extremely  short  time  limits  imposed  by 
i  initial  1-year  congressional  authorization ;  and  then,  second,  the 
lands  of  the  Vice  President's  Task  Force  on  Youth  Employment  for  the 
suits  of  the  YEDPA  research.  This  section  describes  how,  operating 
ler  these  constraints ,  OYP  first  designed  the  knowledge  development 
m  and  then  implemented  it. 


Design  of  the  Plan 

The  YEDPA  legislation  provided  the  Department  of  Labor  and  its  new 
:ice  of  Youth  Programs  with  a  mandate  to  test  the  relative  efficacy 
different  methods  of  dealing  with  the  employment  problems  of  young 
>ricans.  The  legislative  concern  with  learning  what  works  for  whom 
3  consistent  with  the  frequently  stated  contention  that  decades  of 
ieral  funding  for  similar  programs  had  not  yielded  much  in  the  way  of 
Liable  knowledge.  The  YEDPA  research  plan  was  designed  as  a  sys- 
natic  exploration  and  assessment  of  alternatives  for  meeting  the  goal 
knowledge  development. 


policy  initiatives"  over  the  decade  from  1963  to  1973 ,  youth  uneiri 
ment  remained  at  the  same  high  levels  that  had  led  to  the  creatic 
programs  for  youths  in  the  early  1960s.  Among  the  factors  cited 
possible  explanations  was  that  "the  rapid  expansion  of  program 
initiatives  hampered  program  planning,  smooth  implementation ,  and 
thorough  evaluation. "  The  commentary  on  the  research  conducted  p 
to  YEDPA  was  quite  specific  in  its  catalog  of  shortcomings  (U.S. 
Department  of  Labor ,  1978:79) : 

Researchers  are  not  unanimous  in  their  conclusions  about  the 
effectiveness  of  employment  and  training  programs  because  man 
evaluations  have  been  imperfectly  designed,  lacked  sufficient 
followup  data,  or  were  unsuccessful  in  isolating  program 
effects  from  other  factors.  The  failure  to  find  a  suitably 
matched  control  group,  whose  earnings  and  job  success  could  b 
compared  with  those  of  enrollees  .  .  .  flawed  at  least  one 
major  cost-benefit  study. 

A  major  review  (Perry  et  al. ,  1975)  of  252  evaluations  of  emp 
ment  and  training  programs  conducted  under  the  Manpower  Developme 
Training  Act  of  1962  and  the  Economic  Opportunity  Act  of  1964  inc 
that  the  problems  associated  with  evaluation  research  were  not  ur 
to  youth  programs.  This  review  found  that  the  majority  of  employ 
evaluation  studies  were  little  more  than  descriptive  analyses  of 
program  operations  and  of  the  characteristics  of  enrollees,  with 
postprogram  follow-up  data.  Moreover ,  fewer  than  1  in  10  of  the 
evaluation  reports  used  a  control  group  and  "in  almost  every  case 
which  a  control  group  was  used  there  were  valid  reasons  to  questi 
comparability  of  the  controls  and  the  treatment  group"  (Perry  et 
1975:139) .  These  authors  concluded  that  although  there  were  a  la 
number  of  evaluations  of  government  employment  programs  in  the  IS 
and  early  1970s,  "few  [were]  very  useful  as  a  reliable  base  of 
information  from  which  to  draw  firm  conclusions  regarding  [their] 
economic  impact.  ..."  (p.  138) . 

Familiar  with  these  shortcomings,  the  designers  of  the  first 
knowledge  development  plan  identified  the  potential  snares  and  ba 
limitations  of  the  plan's  efforts  (U.S.  Department  of  Labor ,  198C 

First,  new  programs  take  time  to  jell.  .  .  .  What  initial 
studies  can  do  is  identify  who  is  enrolled,  the  services  the} 
receive,  the  immediate  outcome  on  termination,  and  the 
"correctable"  operational  problems .  .  .  .  They  can  indicate 
the  practicality  of  some  designs.  .  .  •  [But]  they  cannot 
determine  long-run  impacts .  Second  efforts  to  track 
postprogram  effects  on  participants  require  considerable  time 
.  .  .  Particularly  for  youth,  the  concern  is  with  even 
longer-run  impacts .  It  takes  from  five  to  ten  years  for  the 
"lasting"  effects  to  surface,  as  youths  mature  into  adult 
workers.  Third,  estimation  of  the  impacts  on  participants 
requires  a  comparison  group  to  indicate  what  would  have 
happened  otherwise .  .  .  .  Development  and  tracking  of  a 


comparison  group  is  technically  difficult,  costly,  and  often 
has  not  yielded  reliable  results.  .  .  .  Fourth,  cost-benefit 
analyses  to  determine  if  benefits  of  programs  expressed  in 
monetary  terms  exceed  the  costs,  are  attractive  in  principle 
but  difficult  in  practice . 

This  premonition  of  the  snares  awaiting  such  research  enterprises  was, 
as  the  following  chapters  document,  fully  borne  out. 

YEDPA ' s  initial  research  plan  was  based  on  eight  questions ,  posed 
by  OYP  in  response  to  the  structure  of  the  YEDPA  legislation  and  its 
funding  formula  (U.S.  Department  of  Labor ,  1980c) : 

•  Does  subsidized  employment  help  youths  complete  their 
schooling  and  does  increased  schooling  increase  the  employability  of 
potential  dropouts  and  the  disadvantaged? 

•  Can  the  school-to-work  transition  process  be  improved? 

•  What  work  experiences  are  worthwhile  and  meaningful  for  youths? 

•  Does  structured,  disciplined  work  experience  have  a  different 
impact  on  the  employment  prospects  of  youths  than  other  types  of 
employment  services? 

•  Are  there  better  ways  of  delivering  employment  and  training 
services  to  youths  than  those  now  in  use? 

•  To  what  extent  do  short-term  interventions  yield  longer  term 
results  (e.g. ,  on  employment  in  adulthood) ? 

•  What  works  best  for  whom? 

•  What  are  the  costs  of  fully  employing  youths? 

Though  revised  and  expanded  over  time  (see  Elmore ,  in  this  volume ) 
these  eight  questions,  vague  and  imprecise  as  they  are,  remained  as  the 
essential  issues  of  the  YEDPA  research  effort.  A  later  plan  describes 
how  specific  demonstration  projects  were  designed  in  response  to  these 
basic  questions ,  but  it  provides  no  overall  framework  specifying 
research  design,  methodology,  standards ,  or  procedures  for  drawing 
together  the  rather  disparate  pieces  of  research  to  address  the  major 
research  issues.  The  YEDPA  research  strategy  was  criticized  from  the 
beginning  as  overly  complex  and  ambitious;  over  time,  rather  than 
evolving  toward  a  clarification  of  major  problems  and  solutions,  it 
became  even  more  complex ,  with  changing  program  designs ,  research 
issues  and  methods,  and  expectations  of  results. 

The  knowledge  development  plan  was  based  on  a  developmental 
management  view  of  research  and  evaluation — as  a  tool  for  instituting 
new  programs  and  then  shaping  and  monitoring  them  as  they  developed. 
Early  studies  were  to  focus  pr imarily  on  process  and  project  imple¬ 
mentation  data.  As  weaknesses  in  program  design  or  procedures  were 
discovered,  adaptations  were  to  be  made  to  improve  the  programs.  As 
programs  evolved ,  their  objectives ,  expected  outcomes ,  and  evaluations 
were  to  be  changed.  This  developmental  approach  to  research  and 
program  operations ,  although  it  complicated  the  research  agenda  and 
tended  to  make  interpretation  of  results  more  difficult,  served  an 
important  management  function  for  OYP  as  it  undertook  the  administra¬ 
tion  of  the  enormous  youth  employment  program.  Unfortunately,  in  many 


projects  the  formative  evaluation  process  was  not  completed  before 
YEDPA  was  terminated. 


Implementation  of  the  Plan 

One  of  the  major  problems  in  implementing  the  knowledge  development 
plan  was  the  sheer  magnitude  of  the  effort  in  relation  to  the  size  of 
the  OYP  staff.  The  demands  of  mounting  expanded  and  new  service 
programs  for  youths  along  with  the  design  and  implementation  of  a 
complex  research  program  necessitated  a  tradeoff  between  careful 
research  design  and  rapid  project  implementation  to  maximize  economic 
impact.  This  pressure  was  intensified  by  the  expectation  that  some 
results  would  be  available  in  time  for  the  CETA  reauthorization 
proceedings  in  late  1978.  The  subsequent  and  equally  unrealistic 
expectation  of  more  detailed  research  results  by  the  fall  of  1979  to 
inform  the  Vice  President's  Task  Force  on  Youth  Employment  served  to 
maintain  the  time  pressure  throughout  the  course  of  YEDPA  operations. 

The  feasibility  of  the  research  effort  was  perhaps  doubtful  from 
the  outset  even  under  the  most  generous  assumptions  of  staff  time  and 
capability:  however,  the  OYP  staff  was  small  in  relation  to  the  size 
of  the  effort  and  also  for  the  most  part  inexperienced  in  research  and 
research  management.  These  constraints,  together  with  the  legislative 
charge  to  involve  other  federal  agencies  and  community-based  organiza¬ 
tions  in  YEDPA  programs,  led  OYP  to  delegate  the  management  of  large 
pieces  of  YEDPA  activity  to  organizations  outside  the  Department  of 
Labor . 

This  strategy  of  indirect  management  involved  five  different  types 
of  negotiated  agreements:  with  "intermediaries,"  other  federal 
agencies,  other  parts  of  the  Department  of  Labor,  other  organizations 
for  staff  support,  and  other  organizations  for  constituency  support. 

In  addition  to  increasing  OYP's  staff  capability  in  administering 
YEDPA,  these  arrangements  were  designed  to  expand  the  institutional 
capacity  of  the  youth  employment  system  for  future  programs.  The 
background  and  functions  of  each  of  these  organizational  arrangements 
are  described  in  detail  in  Elmore  (in  this  volume)  and  summarized 
herein.  Table  3.8  presents  data  on  the  program  budgets  and  tasks 
administered  through  each  arrangement. 

The  intermediary  agreements  with  four  private  nonprofit  corpora¬ 
tions  were  negotiated  for  the  design,  management,  and  evaluation  of 
various  demonstration  projects.  The  agreement  with  the  Manpower 
Demonstration  Research  Corporation,  a  previously  established  firm,  to 
manage  the  entitlement  demonstration  program,  served  as  the  model. 

Three  other  intermediaries  were  created  to  manage  the  private  sector 
youth  employment  demonstrations,  the  exemplary  programs  to  link  school 
and  work,  and,  through  an  interagency  agreement  with  the  Community 
Services  Agency  (CSA) ,  demonstrations  of  youth-run  enterprises. 

Interagency  agreements  were  negotiated  with  several  federal  agencies 
to  meet  congressional  expectations  of  broader  government  involvement  in 
solving  youth  employment  problems.  Projects  funded  through  ACTION; 

CSA;  and  the  Departments  of  Housing  and  Urban  Development;  Health, 


Education,  and  Welfare?  Agriculture?  Energy?  and  Interior  were  designed 
to  meet  youth  employment  objectives  through  means  compatible  with  each 
agency. 

Intraagency  projects  managed  by  the  Office  of  the  Assistant 
Secretary  for  Policy,  Evaluation,  and  Research  (ASPER)  and  by  the 
Office  of  Policy  Evaluation  and  Research  (OPER)  brought  the  expertise 
of  established  Department  of  Labor  research  units  into  the  YEDPA  effort 
and  incorporated  a  YEDPA  sample  into  the  established  Continuous 
Longitudinal  Manpower  Survey  and  a  youth  sample  into  the  National 
Longitudinal  Survey  (see  Chapter  9  and  Appendix  D) . 

External  staff  support  was  provided  primarily  through  the  Brandeis 
University  Center  for  Employment  and  Income  Studies  (CEIS) ,  which  was 
responsible  for  the  analysis ,  dissemination,  and  policy  utilization  of 
the  research  findings.  (CEIS  subsequently  became  part  of  the  uni¬ 
versity's  Center  for  Human  Resources. )  In  responding  to  its  first 
charge,  CEIS  criticized  the  knowledge  development  plan  for  its  complex¬ 
ity  and  lack  of  coherent  framework ,  criticisms  that  the  results  of 
YEDPA  research  suggest  were  warranted,  but  which  unfortunately  were 
unheeded .  Their  role  in  the  retrieval,  synthesis,  and  dissemination  of 
YEDPA  research  was  more  effectively  executed  and  became  critical  in  the 
closing  days  of  YEDPA  when  OYP  was  disbanded  before  the  research  was 
complete. 

Another  important  external  support  function  was  to  have  been 
provided  by  the  Educational  Testing  Service,  for  the  design  and 
analysis  of  a  national  YEDPA  data  base.  The  data  were  generated  by 
application  of  the  Standard  Assessment  System,  a  battery  of  instruments 
administered  to  participants  and  program  operators  to  measure  the 
effectiveness  of  YEDPA  across  sites  and  programs  (see  Chapter  9  and 
Appendix  A) . 

Results  of  many  of  the  youth  projects  funded  through  agreements 
with  outside  agencies  are  unknown .  Only  two  of  the  four  intermediaries 
produced  reports  on  program  effectiveness  that  this  committee  could  use 
in  its  review.  The  vast  majority  of  projects  funded  under  interagency 
agreements  were  not  evaluated.  The  intraagency  projects,  particularly 
those  that  supported  national  data  bases ,  were  among  the  most  successful 
of  the  knowledge  development  activities  in  terms  of  their  methodological 
rigor . 

Overall,  this  management  structure,  although  effective  in  quickly 
initiating  programs  and  research  activities  on  a  large  scale,  was  too 
decentralized  to  manage  the  direction  of  the  programs  effectively  or  to 
analyze  the  research  activities  in  a  coherent  way.  Given  the  level  of 
responsibility  and  authority  delegated  to  the  various  parties,  it  is 
not  surprising  that  they  became  almost  immune  to  centralized  control  of 
their  operations.  And,  given  the  overload  at  the  center,  it  is  not 
surprising  that  OYP  could  not  maintain  control  in  response  to  problems 
arising  in  various  parts  of  the  structure.  Toward  the  end  of  YEDPA, 
but  prior  to  the  completion  of  many  projects  and  their  research  reports, 
the  central  control  literally  fell  apart,  first  with  the  resignation  of 
the  director  of  OYP  and  later  with  the  disbanding  of  OYP  under  the  new 
Reagan  administration.  It  was  at  that  point,  with  many  project  reports 


98 


outstanding,  that  CEIS  assumed  its  critical  role  in  retrieving, 
synthesizing,  and  disseminating  the  research. 


SUMMARY 

The  conditions  under  which  YEDPA  was  implemented,  in  terms  of  its 
legislative  mandates,  its  time  schedules,  and  the  program  and  policy 
environment  in  which  it  operated,  were  significant  in  determining  the 
course  of  YEDPA  programs  and  the  outcomes  of  its  research.  From  its 
legislative  beginnings,  YEDPA  was  constrained  by  two  competing  demand 
to  mount  four  new,  large-scale  jobs  programs  and,  at  the  same  time  an 
through  the  same  delivery  system,  to  design  and  conduct  a  comprehensi 
research  and  demonstration  effort  aimed  at  ameliorating  the  structura 
employment  problems  of  youths. 

The  imposition  of  the  research  and  demonstration  activities  on  th 
already  burdened  service  delivery  system  taxed  the  resources  availabl 
for  both  the  national  management  and  local  operation  of  YEDPA.  The 
additional  pressure  to  launch  these  programs  and  obtain  research 
results  within  1  and  2  years,  respectively,  of  the  passage  of  YEDPA 
further  increased  the  pressures  of  implementation.  The  severe 
consequences  of  all  of  these  conditions  for  YEDPA  program  operations 
and  research,  though  not  quantifiable,  were  readily  apparent  in  the 
numerous  reports  reviewed  by  this  committee  in  its  task  of  assessing 
program  effectiveness.  The  conditions  characterizing  the  implementa¬ 
tion  of  YEDPA  from  its  start  in  1977  through  its  abrupt  halt  in  1981 
were  described  here  to  provide  readers  with  a  context  for  better 
understanding  the  results  of  our  review  of  the  effectiveness  of  the 
YEDPA  programs,  which  we  present  in  the  chapters  that  follow. 


4 

Procedures  Used  in  Evaluating 
the  Effectiveness  of  YEDPA  Programs 


An  explicit  purpose  of  YEPDA  was  the  establishment  of  a  variety  of 
programs  to  explore  alternative  means  of  dealing  with  youth  employment 
problems.  Implicit  in  the  legislation  was  the  concept  that  programs  be 
evaluated  to  determine  their  relative  effectiveness  or  "what  works  best 
for  whom . " 

To  date,  the  only  effort  to  provide  a  systematic  evaluation  of  the 
products  of  the  YEDPA  research  effort  is  that  conducted  by  Hahn  and 
Lerman  (1983)  of  Brandeis  University.  Their  assessment  yielded  what 
are  described  as  "representative"  findings  from  the  YEDPA  evaluations, 
based  on  a  review  of  the  significant  findings,  where  significance  was 
defined  "in  terms  of  the  reliability  of  the  research  reviewed  and  the 
importance  of  the  policies  addressed  by  the  findings"  (Hahn  and  Lerman, 
1983:4).  The  results  of  the  Brandeis  evaluation  focused  attention  on 
the  studies  undertaken  under  YEDPA  and  led,  at  least  indirectly,  to 
this  committee's  creation. 


SOURCES  OF  DATA  AND  CRITERIA  USED  IN  SELECTING  REPORTS 

The  major  source  of  information  that  the  committee  used  for 
assessing  the  effectiveness  of  the  YEDPA  programs  was  the  research  and 
evaluation  reports  commissioned  by  the  Office  of  Youth  Programs  (OYP) 
as  part  of  its  discretionary  knowledge  development  effort.  A  collection 
of  over  400  reports,  compiled  by  the  Employment  and  Training  Administra¬ 
tion  (ETA),  had  been  forwarded  to  us  for  review.  We  also  searched  the 
available  literature  beyond  the  reports  generated  as  part  of  the  YEDPA 
process  (see,  for  example,  the  discussion  of  national  data  bases  in 
Chapter  9)  and  consulted  people  who  had  experience  with  youth  programs 
and  related  research.  Even  so,  with  the  exception  of  studies  of  two 
regular  CETA  programs  (the  Job  Corps  and  the  Summer  Youth  Employment 
Program)  and  Supported  Work,  programs  that  predated  YEDPA,  we  relied 
almost  exclusively  on  the  reports  of  particular  youth  demonstration 
projects  carried  out  under  YEDPA  to  assess  the  effectiveness  of  youth 
programs. 

We  first  screened  the  documents  obtained  for  review  to  identify 
reports  meeting  two  criteria:  (1)  that  the  report  be  on  a  youth 
employment  program  that  had  actually  been  implemented  and  was  in 
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operation  during  the  YEDPA  period  (roughly  1977  to  1981)  and  (2)  th 
the  report  contain  quantitative  data  on  the  effectiveness  of  that  p 
gram,  be  it  at  any  stage  from  implementation  to  program  completion  ■ 
follow-up.  As  a  result  of  this  screening,  we  eliminated  about  170 
reports  from  further  consideration.  These  were  reports  on  subjects 
specifically  related  to  any  implemented  programs,  for  example,  tech 
nical  assistance  guides,  conference  proceedings,  and  program  plans 
descriptions  of  a  general  nature.  Some  of  these  reports  met  the  fi 
condition,  that  is  they  reported  on  youth  programs  actually  impleme 
but  were  not  evaluations  of  program  effectiveness.  Some  others  pur 
ported  to  be  effectiveness  evaluations,  but  were  so  lacking  in  data 
program  outcomes  that  they  could  not  be  evaluated  by  the  committee. 

About  200  reports  on  youth  projects  met  the  initial  screening 
criteria.  For  each  project  the  reports  variously  described  program 
implementation,  in-program  effects,  and  outcome  evaluations.  These 
project  reports  were  then  classified  according  to  program  type  and 
target  group (s)  served  (the  classification  framework  is  described  1 
in  this  chapter) .  The  most  comprehensive  report  on  each  project  wa 
then  subjected  to  a  second  screening  to  identify  reports  of  suffici 
scientific  merit  to  be  reviewed  in  more  depth  by  the  committee  as  t 
basis  for  judging  the  effectiveness  of  YEDPA  programs. 

Reports  were  screened  using  the  following  criteria: 

1.  that  there  be  preprogram  and  postprogram  measurement  of  ma 
program  objectives; 

2.  that  comparable  comparison  group  data  be  presented;  and 

3.  that  initial  sample  sizes  and  response  rates  for  participai 
and  control  groups  be  of  sufficient  size,  preprogram  and  postprogra 
to  allow  usual  standards  of  statistical  significance  to  be  applied 
measured  program  effects,  and  to  alleviate  concern  for  attrition  bi 

Subcommittees  defined  by  the  four  major  program  types  reviewed 
depth  the  project  reports  that  met  the  three  criteria  and  assessed 
their  effectiveness.  Reports  of  interest  for  the  information  they 
provided  on  program  implementation,  whether  or  not  they  met  the 
effectiveness  criteria,  were  included  in  the  implementation  review 
reported  in  Chapter  2.  A  list  of  all  reports  considered  by  the 
committee  for  the  effectiveness  and  implementation  reviews  appears 
Appendix  B. 


COMPARISON  OF  PROJECTS  REVIEWED 
AND  PROJECTS  EXCLUDED  FROM  REVIEW 

The  projects  included  in  the  effectiveness  review  were  selected 
the  basis  of  the  scientific  merit  of  their  research  reports.  The 
projects  that  form  the  basis  of  this  review,  therefore,  may  not 
necessarily  be  representative  of  all  of  the  various  youth  employmen 
projects  operated  under  YEDPA,  either  discretionary  or  formula  fund 
Table  4.1  shows  the  major  YEDPA  discretionary  demonstration 
projects  by  subpart  and  funding  level  and  the  disposition  of  report 


L  Disposition  of  Reports  on  Major  Discretionary  Projects,  by  YEDPA  Subpart  and  Funding  Level, 
>78  and  1979 
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^uu,uuu  ^  ,  through  fiscal  1981. 

projects  operated  unde  bg  revieWed  for  their  effectives 

projects,  17  m  impacts  either  were  not  conraiissior 

because  reports  on  their  p  g  ieCts  were  operated  under  inter 

or  not  produced  ^  rcillio/in  funding.  Two 

agency  agreement  and  acco^  /operated  by  the  Department  of  Hous 
community  conservation  pr  3  acc^ted  for  $21.7  million  in  f undine 

and  Urban  Developme  reports  on  all  44  projects  for  which  rej 

The  committee  screened  reports  on  all  44^  eighfc  ^ 

were  available  (columns  3,  ,  ,  .  *  ef fectivene' 

excluded  at  the  initial  screening  stage  due  to  lack  of  effectivene. 

data  (column  3) .  Two  of  these  projects  alone  accounted  for  $30  mu 
in  funding;  both  were  managed  by  intermediary  organizations  create; 
administer,  operate,  and  evaluate  these  demonstrations. 

Of  the  remaining  36  projects  (columns  4  and  5)  20  upon  fur 
review  did  not  meet  established  criteria  for  comparison  groups  (pr< 
program  to  postprogram) ,  sample  coverage,  and  attrition,  and  they  v 
excluded  from  further  consideration  (column  4).  Five  of  these  pro; 
accounting  for  $15  million  in  funding,  were  operated  under  interage 
agreements,  including  the  Youth  Community  Services  Demonstration  ai 
the  Career  Intern  Program.  Also  excluded  was  the  Vocational 
Exploration  Demonstration,  a  major  project  funded  at  $8.7  million. 

In  addition  to  the  projects  shown  in  Table  4.1,  we  reviewed  an< 
excluded  five  other  demonstration  projects  not  included  in  the 
1978-1979  funding.  None  of  these  represented  a  major  budget  amouni 
Our  review  indicated  that  reports  on  16  projects  (column  5)  me 
established  criteria,  and  they  were  therefore  included 


YEDPA  program  effectiveness.  These  16  projects  represent  about  63 
percent  of  YEDPA  discretionary  funding,  including  the  entitlement 
program  (YIEPP) .  The  projects  include  YIEPP  ($240.2  million),  Ven 
in  Community  Improvement  ($10.8  million)  ,  the  Youth  Career  Develop] 
Project  for  School- to-Work  Transition  ($9.6  million),  three  Summer 
Career  Exploration  Projects  ($6.8  million),  the  Public  Versus  Priv. 
Sector  Jobs  Demonstration  ($7.6  million),  and  the  Service  Mix  Alte 
natives  Demonstration  ($5.3  million). 

In  addition  to  the  discretionary  projects  listed  in  this  table 
also  included  in  our  review  the  two  largest  regular  CETA  youth  pro* 
the  Job  Corps  and  the  Summer  Youth  Employment  Program,  as  well  as 
youth  portion  of  the  Supported  Work  demonstration  project.  Also 
included  but  not  shown  in  this  table  were  nine  other  discretionary 
projects  not  included  in  the  1978-1979  fundings.  These  additional 
projects  bring  the  total  number  of  projects  included  in  our  review 
28,  representing  every  subpart  of  YEDPA  (with  the  exception  of  the 
Young  Adult  Conservation  Corps) ,  including  the  Job  Corps  and  the  s 
youth  program. 


OVERALL  FRAMEWORK  FOR  EVALUATION 


Our  framework  for  evaluating  the  effectiveness  of  YEDPA  programs 
caws  together  three  major  dimensions?  program  goals,  program  types, 
nd  target  groups.  We  organized  our  review  primarily  according  to 
cogram  type,  noting,  in  addition,  the  target  groups  served  and 
ssessing  the  degree  to  which  the  programs  affected  each  of  the  given 
cogram  goals  (when  measurements  bearing  on  each  were  provided) .  There 
ore,  the  discussion  of  program  effectiveness  appearing  in  Chapters  5 
irough  8  is  presented  largely  in  terms  of  program  types.  In  the 
actions  that  follow  we  discuss  each  of  these  dimensions  briefly. 


Program  Goals 

The  YEDPA  legislation  states  a  variety  of  goals  for  youth  programs 
see  Elmore  in  this  volume)  .  Goals  or  outcomes  can  be  divided  into 
ntermediate  goals  and  long-run  or  ultimate  goals.  The  long-run  goals 
E  different  employment  and  training  programs  are  generally  similar; 

Dst ,  if  not  all,  programs  intend  to  effect  longer-term  improvement  in 
articipants '  employment  stability,  earnings,  family  stability,  and  so 
Drth.  Intermediate  program  goals,  such  as  increased  educational 
ttainment,  work  experience,  knowledge  of  and  attitudes  about  the 
Drkplace,  and  short-run  increases  in  employment  and  earnings,  vary 
sross  programs. 

Long-run  program  goals  are  of  ultimate  interest  from  both  social 
nd  policy  perspectives.  Intermediate  goals,  while  not  usually  ends  in 
hemselves,  may  serve  as  indicators  of  long-run  outcomes  to  the  extent 
hat  they  are  expected  to  affect  longer-term  goals.  Ultimately,  whether 
ntermediate  goals  are  reliable  indicators  of  longer-range  outcomes  is 
n  empirical  question.1 


ogram  Types 

Under  YEDPA  an  attempt  was  made  to  ensure  that  a  wide  array  of 
cogram  types  were  tested,  covering  in  one  fashion  or  another  most  of 
he  concepts  about  appropriate  program  types  that  would  emerge  from  a 
ystematic  analysis  of  goals  (U.S.  Department  of  Labor,  1980b).  How- 
ver,  even  the  documents  describing  the  knowledge  development  effort  do 
Dt  provide  a  categorization  of  program  types  that  lends  itself  readily 
o  a  classification  scheme  useful  for  evaluating  the  effectiveness  of 
EDPA  programs.  Others  who  have  reviewed  youth  programs  have  used 


This  formulation  of  program  goals  relies  heavily  on  Barth  (1972) . 
s  will  be  discussed  in  detail  in  subsequent  chapters,  YEDPA 
scretionary  projects  devoted  substantial  resources  to  the  collection 
f  data  on  measures  of  intermediate  goals,  much  of  it  (such  as  attitude 
easures)  subjective  in  nature. 


TABLE  4.2  Youth  Program  Classifications 


Service  Category  Classifications 

PIQ  Service 

Categories3 

Hahn  and  Lerman 

Committee  on  You! 
Employment  Progrc 

Testing,  assessment 

Labor  market 

Labor  market 

and  employability 

preparation 

preparation 

plan  development 

(career  development) 

Counseling 

Labor  market 

Labor  market 

(personal  and 

preparation 

preparation 

career) 

(career  development) 

Other  preemployment: 

Labor  market 

Labor  market 

World-of-Work 

preparation 

preparation 

Basic  Skills 

(career  development) 

Job  Search 

Vocational 

Labor  market 

Labor  market 

exploration,  job 

preparation 

preparation 

rotation 

(career  development) 

Remedial  education, 

b 

Labor  market 

GED,  ESL 

preparation 

Classroom 

Intensive  skills 

Occupational 

vocational  skills 

training  (out-of-school. 

skills  training 

training 

e.g . ,  Job  Corps) 

On-the-job  training 

Intensive  skills 

Occupational 

training  (out-of-school) 

skills  training 

Work  experience 

Work  experience:  in- 

Temporary  jobs 

school  and  out-of- 
school 

programs 

Summer  Youth 

Employment  Program 

Temporary  jobs  pi 

Support  services 

b 

b 

(transportation, 
child  care) 

Placement  and  job 

Labor  market 

Job  placement 

development 

preparation 

program 

NOTE:  This  chart  compares  the  program  classifications  used  by  Hahn  and  Lerman  (198 
and  the  committee.  The  first  column  presents  the  10  service  activities  from  the 
Process  Information  Questionnaires  (PIQ)  of  the  Standard  Assessment  System  (SAS)  ,  a 
the  columns  to  the  right  indicate  how  Hahn  and  Lerman  and  CYEP  classify  each  PIQ 
service  category  for  assessment  purposes.  The  CBO  (1982)  in  its  analysis  of  youth 
programs  classified  program  activities  as  demand  side  (i.e.,  to  increase  employment 
demand  for  the  target  group),  supply  side  (i.e.,  to  increase  employability  of  youth 
through  training,  education,  and  employment  experience),  or  transition  (i.e., 
improving  exchange  of  labor  through  job  search  and  placement)  . 

aOther  authors  have  used  classifications  based  on  amounts  of  time  in  various  PIQ 
categories  for  analysis  of  youth  programs  (Cole  et  al.  ,  1982;  Fuller  and  Nelson, 
1982;  Rock  et  al. ,  1982) . 

*-*Not  classified. 


different  classifications  from  those  used  in  the  knowledge  develop! 
documents  (e.g.,  Hahn  and  Lerman,  1983?  Rock  et  al.,  1982?  and  Cone 
sional  Budget  Office,  1982?  see  Table  4.2). 

None  of  the  classifications  of  program  types  developed  and  uti] 
by  others  seemed  appropriate  for  our  task.  These  classifications  v 
often  based  on  combinations  of  specific  program  activities  and  ser^ 


(e.g. ,  work  experience,  on-the-job  training,  classroom  training,  skills 
training,  counseling,  and  participant  assessment),  on  the  one  hand,  and 
client  group  characteristics,  on  the  other .  On  examination,  we  found 
that  most  YEDPA  programs  provided  combinations  of  services  to  a  mix  of 
client  groups.  Thus,  reviews  based  on  classifications  with  fine 
breakdowns  of  service  type  and  client  group  were  forced  to  discuss  a 
given  program  repeatedly  under  different  classifications  of  services 
(e.g.,  Hahn  and  Lerman,  1983). 

In  designing  the  classifications  of  programs  for  this  review  we 
sought  to  minimize  complexity  without  obscuring  essential  differences 
between  programs.  To  this  end,  we  chose  four  broad  program  types 
defined  on  the  basis  of  intermediate  goals.  Each  program  evaluation 
report  was  placed  in  only  one  type,  according  to  its  intermediate  goal: 

1.  Occupational  skills  training:  to  equip  youths  with  specific 
occupational  skills  and  knowledge  as  a  prerequisite  either  to  further 
training  or  job  placement  in  that  occupational  field.  (Examples  include 
both  on-the-job  and  classroom  training  in  such  fields  as  welding, 
drafting,  carpentry,  health,  and  computer  occupations.) 

2.  Labor  market  preparation:  to  improve  attitudes,  knowledge,  and 
basic  skills  as  preparation  for  entering  employment.  This  category 
encompasses  such  programs  as  career  exploration  and  world-of-work 
orientation  and  programs  designed  to  enhance  youths'  general  educational 
level  and  skills,  thereby  improving  their  future  career  possibilities. 
(Examples  of  the  latter  are  basic — remedial — education  and  GED 
programs. ) 

3.  Temporary  jobs:  to  provide  youths  with  employment  and  general 
work  experience  in  temporary  subsidized  jobs,  either  full  time  or  part 
time.  (Examples  of  such  programs  include  work  experience  programs  and 
the  Summer  Youth  Employment  Program.) 

4.  Job  placement:  to  place  youths  in  unsubsidized  jobs.  Services 
provided  may  include  job  search  assistance,  placement,  and  follow-up 
activities. 


Target  Groups 

At  the  outset,  our  evaluative  framework  cross-classified  programs 
by  the  four  broad  program  types  just  described  and  by  the  target  groups 
served,  as  classified  by  school  status  and  age.  School  status  distingu¬ 
ished  in-school  youths  from  out-of-school  youths,  the  latter  being 
further  subdivided  into  those  who  had  graduated  from  high  school  and 
those  who  had  dropped  out.  The  age  groups,  defined  to  correspond 
roughly  with  grade  level,  were  14-15,  16-18,  and  19-21.  The  racial, 
ethnic,  and  sex  composition  of  program  participants  were  also  indicated. 
It  was  our  hope  that  this  specification  of  target  groups,  cross- 
classified  with  program  types,  would  allow  us  to  address  the  question 
of  what  works  best  for  whom. 

In  practice,  while  we  did  take  note  of  the  details  of  participant 
target  groups,  we  found  it  was  not  possible  to  carry  out  separate 
analysis  according  to  all  of  these  target  group  categories.  This  was 


primarily  due  to  the  fact  that  most  of  the  programs  contained  mixes 
participants  from  the  different  categories  and  few  of  the  evaluatio 
reports  on  which  our  assessments  were  based  provided  separate  outco 
analyses  for  different  categories  of  participants  conforming  to  our 
detailed  classification.  As  a  result,  while  our  reviews  of  program 
effectiveness  provide  as  detailed  information  as  the  source  materia 
allows,  our  summary  conclusions  distinguish  only  between  in-school 
out-of-school  youths,  cross-classified  by  program  type. 


LIMITATIONS  OF  THIS  REVIEW 

Our  ability  to  draw  firm  conclusions  about  the  effectiveness  of 
youth  employment  and  training  programs  was  constrained  by  two  condi 
that  affected  the  implementation  of  YEDPA  and  particularly  the  cond' 
of  research.  First,  YEDPA  programs  and  research  were  mounted  in  coi 
siderable  haste  in  a  period  in  which  many  other  employment  and  trail 
and  research  efforts  were  ongoing,  so  that  both  program  and  resear  cl 
resources  were  stretched  very  thin.  Second,  in  1981,  less  than  3  yi 
after  their  quick  start-up  and  troubled  implementation,  many  prograi 
and  evaluation  efforts  were  abruptly  halted  with  the  change  of  admii 
tration. 

As  a  consequence  of  these  factors,  most  of  the  data  on  which  ev. 
ations  were  based,  with  a  few  exceptions,  were  gathered  at  a  stage  ; 
which  programs  had  not  yet  become  stabilized.  As  a  further  conseqn 
relatively  few  program  evaluations  provide  data  for  long  postprograi 
periods;  virtually  all  of  the  YEDPA  project  evaluations  had  postpro* 
follow-ups  of  only  3  to  8  months.  Only  two  evaluations  had  as  much 
a  3-year  follow-up,  and  both  of  those  were  of  pre-YEDPA  programs  (tl 
Job  Corps  and  Supported  Work) . 

Further  limiting  our  ability  to  draw  firm  conclusions  were  the 
serious  problems  many  YEDPA  researchers  apparently  had  in  creating 
reasonable  comparison  groups  and  preventing  sample  attrition  over  w. 
of  the  data  collection.  These  problems  sharply  reduced  the  number  < 
studies  that  could  be  reviewed  and  put  in  question  the  reliability  < 
the  results  of  several  others. 

A  final  limitation  of  this  review  concerns  the  very  magnitude  o: 
YEDPA  and  CETA  programs  from  1977  through  1981.  It  has  been  estimai 
that  in  1978  as  much  as  one-half  of  all  jobs  held  by  black  teenager; 
during  the  summer  were  in  the  summer  program  and  as  much  as  two-fifi 
of  jobs  held  in  1979  were  in  government  employment  and  training  proi 
(Crane  and  Ellwood,  1984;  Elmore,  in  this  volume).  Thus,  even  when 
comparison  groups  were  reasonably  created,  there  may  well  have  been 
substantial  amounts  of  employment  and  training  among  the  comparison 
group  members.  To  the  degree  this  program  participation  is  undetec 
in  the  evaluation  data,  the  participant-comparison  contrasts  will 
underestimate  the  impact  of  these  programs. 

We  have  attempted  to  test  the  individual  YEDPA  research  reports 
against  reasonable  standards  of  scientific  quality  with  respect  to  1 
the  data  collected  and  the  methods  used  to  measure  program  effects. 
The  reports  that  met  such  standards  were  not  necessarily  evenly 
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distributed  over  the  range  of  operational  youth  programs  or  target 
groups  being  served.  Thus,  there  are  issues  with  respect  to  the  role 
and  effectiveness  of  youth  employment  and  training  programs  that  we 
could  not  address  due  to  a  dearth  of  reliable  evidence.  In  addition, 
the  quality  of  the  available  evidence  varies,  sometimes  supporting 
strong  conclusions,  sometimes  merely  suggesting  the  direction  of 
program  effects. 

Our  assessments  of  the  effectiveness  of  youth  programs  derive  from 
examining  published  evaluation  reports  on  these  efforts  rather  than  our 
own  evaluation  of  the  programs  themselves.  Since  it  is  possible  that 
poorly  executed  or  poorly  presented  research  reflects  unfairly  on  the 
programs  being  examined,  it  is  important  that  we  clearly  distinguish 
between  the  quality  of  the  research  and  the  (possibly  unobserved) 
quality  of  the  programs. 

While  we  have  attempted  to  avoid  drawing  inferences  about  program 
effectiveness  on  the  basis  of  research  quality,  and  are  fairly  confident 
that  we  have  been  successful  in  doing  so,  we  caution  the  reader  to  bear 
in  mind  that  to  make  a  determination  of  either  effectiveness  or 
ineffectiveness  requires  credible  evidence.  Lack  of  evidence  on 
effectiveness  is  not  synonymous  with  lack  of  effectiveness. 

In  our  evaluation  of  the  effectiveness  of  youth  employment  and 
training  programs,  issues  related  to  the  adequacy  of  the  evidence  often 
overshadowed  those  related  to  the  policy  or  practical  significance  of 
the  magnitudes  of  reported  effects.  The  question  of  the  reliability  of 
estimated  effects  is  logically  prior  to  a  consideration  of  their  policy 
importance.  Consequently,  when  results  fail  the  test  of  reliability 
(in  an  evaluative  or  statistical  sense) ,  further  discussion  of  their 
implications  for  policy  is  rendered  moot.  Because  many  of  the  reports 
we  reviewed  did  not  provide  reliable  estimates  of  program  effects,  we 
often  could  not  address  the  issue  of  the  policy  significance  of  the 
findings. 
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Effectiveness  of  Occupational  Skills 
Training  Programs 


Skills  training  programs  are  generally  designed  to  impart  skills 
relevant  to  obtaining  work  in  specific  occupations.  We  found  that  few 
youth  programs  exclusively  devoted  to  skills  training  were  undertaken 
with  YEDPA  discretionary  funds.  Moreover,  there  is  a  paucity  of  YEDPA 
evaluation  reports  on  such  programs  relative  to  the  number  of  reports 
on  other  types  of  program.  We  are  left,  in  effect,  with  only  two 
programs — the  Job  Corps  (which  was  developed  prior  to  YEDPA)  and  New 
Youth  Initiatives  in  Apprenticeship — that  had  substantial  skills 
training  components  and  were  sufficiently  well  evaluated  and  documented 
to  be  subjects  for  our  review.  Yet  each  of  these  programs  had  special 
features  that  limit  its  applicability  to  broad  segments  of  the  youth 
population:  the  Job  Corps  is  a  residential  program  for  out-of-school 
youths  that  includes  much  more  than  skills  training;  and  the  apprentice 
ship  program  required  a  close  relationship  between  employers  and  school 
programs  dealing  with  specialized  skills.  Table  5.1  presents  the  char¬ 
acteristics  of  these  two  programs;  Table  5.2  summarizes  the  research 
design  and  results  of  their  evaluations. 

That  few  skills  training  programs  were  developed  under  YEDPA — which 
is  consistent  with  a  frequently  voiced  criticism  of  all  CETA  programs 
operating  during  the  1970s — apparently  grew  out  of  several  concerns  of 
program  administrators.  One  concern  was  the  belief  that  below  a  certai 
age  young  people  tend  to  lack  the  seriousness  to  make  good  use  of  skill 
training  because  they  have  not  committed  themselves  to  a  particular 
occupational  direction.  Another  concern  is  that  participants  require  a 
sufficiently  high  level  of  academic  preparation  to  be  able  to  partici¬ 
pate  effectively  in  any  but  the  most  general  training,  and  many  progran 
applicants  lack  this  level  of  preparation.  In  fact,  as  was  noted  in 
Chapter  4  and  is  discussed  in  Chapters  7  and  8,  some  program  efforts 
initially  designed  to  provide  skills  training  were  redesigned  when  it 
became  clear  that  participants  were  primarily  in  need  of  more  basic 
educational  skills  training. 
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Occupational  Skills  Training  Programs:  Program  Characteristics 
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PROGRAM  FOR  OUT-OF-SCHOOL  YOUTHS 


Job  Corps 

The  Job  Corps  is  in  many  respects  unique .  It  is  distinguished  by 
le  population  it  serves,  the  comprehensive  nature  of  the  services  it 
Efers,  its  stability  as  a  program,  and  the  quality  of  the  evaluation 
at  is  available  on  it.  We  note  that  these  last  two  points  are 
robably  not  unrelated. 

The  Job  Corps  is  a  largely  residential  program  for  out-of-school, 
sonomically  disadvantaged  youths  between  14  and  21  years  old.  It 
rovides  a  range  of  services  including  remedial  (basic)  education, 
national  skills  training,  and  health  care  to  enrollees  for  about  30 
seks  (the  average  stay  during  the  subject  evaluation) . 

The  Job  Corps  serves  a  severely  disadvantaged  population:  about  90 
srcent  of  Job  Corps  enrollees  were  either  from  households  below  the 
jverty  line  or  receiving  welfare  benefits;  more  than  75  percent  were 
Lnorities,  and  30  percent  were  female.  Moreover,  despite  the  fact 
lat  the  median  age  of  Job  Corps  enrollees  was  about  18,  median  reading 
_vels  were  at  or  below  the  sixth-grade  level. 

The  Job  Corps  has  existed  for  20  years;  few  programs  have  had  such 
Lability.  The  program  served  about  102,000  youths  in  fiscal  1985  in 
Ly 000  slots;  enrollees  averaged  just  under  5  months  participation.  At 
le  time  of  the  evaluation  we  reviewed,  about  70,000  participants  were 
sing  served  per  year. 

Although  the  Job  Corps  has  been  substantially  modified  since  it  was 
Lrst  established  in  1964,  most  evaluations  of  the  program  prior  to  the 
382  study  we  reviewed  were  based  on  the  experience  of  those  who  par- 
Lcipated  in  the  Job  Corps  during  the  mid-1960s.  A  series  of  surveys 
{  Louis  Harris  and  Associates  served  as  the  primary  data  source  for 
^searchers  attempting  to  estimate  the  impact  of  Job  Corps.  These 
irly  studies  had  conflicting  findings.  For  example,  one  study  (Cain, 
)68)  found  that  participants  earned  $188  to  $260  per  year  more  than 
io-shows"  (those  who  enrolled  but  never  participated)  6  months  post- 
:ogram.  Another  study  (Woltman  and  Walton,  1968)  found  no  significant 
Lfference  between  the  earnings  of  Job  Corps  enrollees  and  early 
srminees  (those  who  remained  in  the  program  less  than  3  months)  18 
3nths  after  participation.  Taken  together,  these  early  findings 
lggested  that  Job  Corps  had  a  short-term  impact  that  decayed  (faded) 
irly  quickly  (Goldstein,  1973)  . 

Our  assessment  of  the  Job  Corps  is  based  on  an  evaluation  conducted 
r  Mathematica  Policy  Research,  Inc.  (Mallar  et  al.,  1982).  This 
/aluation  was  the  most  extensive  and  sophisticated  of  the  studies  of 
le  Job  Corps  undertaken  over  the  years.  And,  unlike  most  evaluations 
E  other  youth  employment  programs  that  we  reviewed,  this  study: 

•  was  based  on  a  large  sample  of  program  participants  (2,800) 
d  nonparticipants  (1,000)  who  were  similar  in  most  respects  to  Job 
>rps  participants.  The  nonparticipants  were  youths  eligible  for  Job 
rps  who  were  residing  in  geographic  areas  where  Job  Corps  enrollment 
is  low. 


9  gathered  data  on  the  participant  and  comparison  groups  for  a 
reasonably  long  time  after  the  program  so  that  it  was  possible  to 
establish  the  degree  to  which  postprogram  effects  exist  and  persist  or 
decay.  The  third  follow-up  interview  was  conducted  42-54  months  after 
the  program  period. 

9  had  low  rates  of  attrition  in  the  follow-up  samples  of 
participant  and  comparison  group  members.  The  third  follow-up  survey 
was  completed  by  70  percent  of  those  who  completed  the  original 
baseline  questionnaire  (65  percent  of  participants  and  75  percent  of 
comparison  group  members)  . 

9  took  measurements  on  a  wide  variety  of  factors  that  could  be 
affected  by,  or  affect,  the  Job  Corps  experience,  including  educationa. 
attainment,  the  value  of  economic  production  by  Job  Corps  participants 
receipt  of  welfare  and  other  transfers,  the  extent  of  criminal 
activity,  unemployment  rates,  employment  rates,  hours  worked,  and  wage 
rates. 

9  used  a  comparison  group  methodology  in  a  way  that  was  as 
careful  and  technically  sound  as  the  state  of  the  art  permitted. 

The  essential  finding  of  the  Mathematica  evaluation  is  that  the  Jol 
Corps  "works."  In  particular: 

•  On  average,  participants  in  the  Job  Corps  were  employed  about 
3  weeks  per  year  (13  percent)  more  than  nonparticipants  up  to  3-1/2 
years  postprogram,  and  their  earnings  gains  after  leaving  the  Job  Corp 
were  estimated  to  be  $567  per  year  higher  in  1977  dollars  (28  percent) 
for  enrollees  than  they  would  have  been  in  the  absence  of  the  Job  Corpi 
experience.  The  amount  of  time  that  Job  Corps  enrollees  received  cash 
welfare  or  unemployment  compensation  benefits  was  lower  by  2  weeks  per 
year  and  1  week  per  year,  respectively,  compared  with  nonparticipants. 
Table  5.3  presents  evaluation  results  up  to  4  years  after  Job  Corps 
participation. 

9  Participants'  educational  attainment  increased  substantially 
while  they  were  in  the  Job  Corps:  the  probability  that  enrollees  wouL 
receive  a  high  school  diploma  or  its  equivalent  (General  Equivalency 
Diploma)  within  the  first  six  months  after  leaving  the  Job  Corps  was 
.24  for  enrollees  compared  with  .05  for  comparison  group  members. 

9  Overall,  the  health  of  Job  Corps  participants  was  better  than 
that  of  nonparticipants  after  the  program;  participants  reported  about 
1  week  less  per  year  of  serious  health  problems. 

9  Criminal  activity,  as  indicated  by  rates  of  arrest,  was 
significantly  lower  for  participants  during  the  period  of  the  program, 
and  after  leaving  the  program  participants  had  fewer  arrests  for 
serious  crimes  than  nonparticipants. 

9  After  an  initial  6-month  postprogram  period,  when  enrollees 
fared  worse  than  the  comparison  group  in  terms  of  employment  and 
earnings,  the  aggregate  positive  effects  of  Job  Corps  emerged  and 
persisted  at  a  relatively  stable  rate  throughout  the  4-year  follow-up 
period.  This  outcome  suggests  that  the  main  effects  of  Job  Corps  do 
not  stem  from  job  placement. 


TABLE  5.3  Estimated  Job  Corps  Effects  on  Employment  and  Earnings, 
Including  Military  Sector:  First  Through  Fourth  Postprogram  Years 


Months  After 

Termination 

Employed 

(fraction  of  time) 

Weeks  Worked 
per  Six  Months 

Hours  Worked 
per  Week 

Weekly  Earnings 
(1977  dollars) 

0-6 

-0.018 

-0.47 

0.79 

-0.21 

6-12 

0.070* 

1.82* 

3.19* 

10.27* 

12-18 

0.113* 

2.94* 

5.19* 

15.64* 

18-24 

0.081* 

2.11* 

3.76* 

9.42* 

24-30 

0.081* 

2.11* 

3.44* 

10.20* 

30-36 

0.075* 

1.95* 

3.35* 

11.59* 

36-42 

0.068* 

1.77* 

3.20* 

10.12* 

42-48 

0.040 

1.04 

1.62 

5.47 

*Statistically 

significant  at  the 

.05  level  or  below 

in  a  two-tailed 

test. 

SOURCE:  Data  from  Mallar  et  al.  (1982:Tables  IV. 10  and  IV. 11). 


These  overall  effectiveness  estimates  included  all  participants, 
early  leavers  as  well  as  those  who  followed  the  Job  Corps  course  to 
completion.  The  study  also  provides  estimates  of  differences  in  effects 
according  to  categories  of  program  completion.  Program  completers 
composed  40  percent  of  the  sample,  while  partial  completers  and  early 
dropouts  each  accounted  for  30  percent.  Program  completers  benefited 
most.  Partial  program  completers,  those  who  stayed  at  least  90  days 
and  completed  at  least  one  specific  segment  of  a  vocational  or  educa¬ 
tional  program  but  not  an  entire  program,  benefited  about  one-third  as 
much  as  completers.  Early  dropouts  were  found  to  benefit  little  or  not 
at  all.  The  authors  note,  however,  that  econometric  methods  for  con¬ 
trolling  for  bias  in  selection  into  the  three  completion  categories 
would  not  prove  effective. 

Program  effects  were  estimated  separately  for  males  (representing 
70  percent  of  corps  members  and  70  percent  of  the  follow-up  sample) , 
females  without  children  (21  percent  of  the  follow-up  sample) ,  and 
females  with  children  present  (9  percent  of  the  follow-up  sample) . 

The  estimated  effects  on  employment  and  earnings  are  similar  in 
magnitude  for  males  and  females  without  children,  though  somewhat  more 
erratic  over  the  postprogram  period  for  females.  For  females  with 
children  present,  the  employment  and  earnings  effects  are  both  lower 
and  more  erratic  than  for  the  other  two  groups.  The  authors 
hypothesize  that  the  lower  effect  for  women  with  children  may  be  due  to 
the  higher  proportion  of  very  young  children  among  the  participants 
than  among  the  comparisons.  This  difference  is  apparently  due  to 
delays  in  childbearing  by  participants  during  the  in-program  period, 
followed  by  a  higher  rate  of  postprogram  births  than  among  comparison 
group  members.  The  result  is  the  presence  of  a  greater  number  of  young 
children  among  participants  in  the  postprogram  period. 
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Effects  of  the  program  on  crime  are  estimated  from  self-report* 
arrest  data  gathered  in  interviews  with  participants  and  comparisoi 
group  members.  The  major  effects  are  estimated  to  occur  during  th< 
period  in  which  participants  are  in  the  program,  when  total  arrests 
incarcerations  were  significantly  lower  for  Job  Corps  members  than 
the  comparison  group.  In  the  postprogram  period,  the  estimates  she 
overall  reduction  in  arrests  (statistically  significant  for  males), 
reduction  in  theft  arrests,  an  increase  in  auto-related  arrests,  ar 
effect  on  time  in  jail. 

When  the  benefits  and  costs  of  the  program  were  estimated — in  i 
quite  detailed  and  sophisticated  benefit-cost  analysis — the  study  i 
that  from  the  view  of  society  as  a  whole,  the  net  present  value  of 
benefits  exceeded  costs  by  $2,300  per  enrollee  (in  1977  dollars)  . 
the  view  of  the  participants,  benefits  exceeded  costs  by  $2,400  on 
average.  For  nonparticipants  (i.e.,  private  benefits  and  costs),  c 
cost  of  $115  per  enrollee  was  incurred,  representing  a  net  redistrj 
tion  of  resources  from  nonparticipants  to  Job  Corps  participants. 

The  estimated  magnitude  of  the  benefit-cost  difference  is 
particularly  sensitive  to  the  assumptions  regarding  the  magnitude  c 
the  effect  of  the  program  in  reducing  crime.  The  evaluation  assume 
that  actual  arrests  were  underreported  by  70  percent  among  members 
the  Job  Corps  sample;  this  assumption  is  based  on  a  study  done  for 
evaluation  of  the  Supported  Work  program. 

Considerable  attention  has  been  devoted  to  the  issue  of  the 
correlation  between  self-reports  and  official  reports  of  criminalit 
and  arrests  in  the  criminal  justice  field.  There  is  no  generally 
accepted  differential  between  self-reported  and  official  data  on 
criminality  that  supports  the  use  of  any  given  numerical  factor  to 
increase  the  self-reported  incidence  of  arrests.1  However,  even  wfc 
it  is  assumed  that  no  postprogram  crime-reduction  benefits  are 
associated  with  Job  Corps,  the  net  present  value  of  the  program  to 
society  is  still  positive,  about  $500  per  enrollee. 

The  Job  Corps  evaluation  was  extensively  reviewed  by  outside 
experts  in  1982  at  the  request  of  the  Office  of  Management  and  Budc 
The  reviewers  did  not  find  any  major  problems,  though  one  had  some 
doubts  about  the  adequacy  of  the  selection  bias  corrections.  We  ha 
some  remaining  reservations  about  the  Job  Corps  evaluation  that  are 
largely  technical  in  nature. 

Random  assignment  to  the  Job  Corps  and  to  a  control  group  was  r 
out  by  the  Department  of  Labor  at  the  outset.  Given  that  constrain 
the  comparison  group  strategy  seems  to  have  been  well  conceived  and 


XA  recent  summary  of  research  on  the  use  of  self-reported  measures 
delinquency  indicates  widely  varying  estimates  of  underreporting 
depending  on  method  of  administration  (questionnaire  or  interview) 
sample  characteristics  (sex,  race,  socioeconomic  background,  school 
status,  and  previous  contact  with  police)  .  Underreporting  appears 
serious  among  black  males  with  previous  delinquent  offenses  (Hindel 
et  al.,  1981) . 


for  the  most  part,  well  executed.  Comparison  group  members  were  drawn 
from  geographical  areas  that  were  similar  to  the  home  areas  of  Job 
Corps  members  but  that  had  low  rates  of  previous  enrollment  in  the  Job 
Corps.  Within  these  areas,  sample  members  were  drawn  with  selection 
probabilities  in  proportion  to  their  similarity  to  Job  Corps  partici¬ 
pants  in  terms  of  age,  poverty  status,  race,  and  education. 

Beyond  controlling  for  measured  characteristics  when  estimating 
effects,  the  evaluation  attempted  to  control  for  selection  bias  by 
modeling  the  selection  process  using  the  methods  suggested  by  Heckman 
(1979) .  While  the  selection  bias  correction  appears  to  have  worked 
well,  more  detailed  information  than  that  available  in  the  report  is 
required  to  remove  some  residual  doubts  as  to  whether  this  correction 
dealt  completely  with  self-selection  problems.  The  efforts  at  correc¬ 
tion  go  considerably  beyond  those  usually  applied  when  dealing  with 
comparison  groups  (rather  than  randomly  assigned  controls  groups) ,  but 
the  nature  of  the  comparison  group  renders  the  evidence  of  program 
effects  less  convincing  than  it  would  be  had  a  randomly  assigned 
control  group  methodology  been  used. 

The  Job  Corps  provides  a  comprehensive  set  of  services  and  whether 
the  comprehensiveness  is  central  to  the  effectiveness  of  the  program 
has  not  been  directly  evaluated.  Apparently,  earlier  reports  did 
provide  some  estimates  of  the  difference  in  impact  according  to  the 
members'  exposure  to  particular  components,  but  those  results  were  not 
reported  in  the  Mathematics  study  and  mention  is  made  of  selection  bias 
problems  in  making  assessments.  Since  participants  are  not  randomly 
assigned  to  the  various  components,  self-selection  factors  seem  likely 
to  be  confounded  with  the  actual  effects  of  the  component  in  which  a 
participant  is  enrolled.  We  do  not  have  sufficiently  detailed  evidence 
that  allows  us  to  isolate  the  elements  of  the  Job  Corps  program  and 
determine  whether  (or  for  whom)  the  residential  element  of  the  program 
is  critical;  whether  the  health  component  is  essential;  or  whether  the 
skills  training  offered  adds  to  any  effects  that  the  basic  education 
elements  may  have  created — or  vice  versa. 

Since  women  represent  about  30  percent  of  Job  Corps  enrollees,  the 
desire  to  obtain  reliable  estimates  by  sex  led  to  the  selection  of  a 
comparison  group  that  was  50  percent  female.  Unfortunately,  it  appears 
that  the  enrollee  and  comparison  groups  for  women  were  not  adequately 
matched  on  child-responsibility  status.  According  to  the  final 
follow-up  report,  almost  none  of  the  female  corps  member  sample 
initially  had  children  present,  but  by  the  time  of  the  final  follow-up 
interview  approximately  50  percent  of  the  women  had  children  present. 
Thus,  female  Job  Corps  members  with  children  represented  about  2  percent 
of  the  sample  in  the  first  6  months  of  the  postprogram  period  and  15 
percent  of  the  sample  during  the  last  6  months  of  the  study  period 
(42-48  months  after  leaving  the  program) . 

In  fact,  baseline  data  from  an  earlier  report  indicate  significant 
differences  between  participant  and  comparison  group  members,  particu¬ 
larly  among  females  (Kerachsky  and  Mallar,  1977).  Approximately  3 
percent  of  the  female  participants  were  pregnant  at  the  baseline  com¬ 
pared  with  12  percent  of  comparison  group  females.  Female  participants 
were  significantly  more  likely  to  be  black,  Hispanic,  or  members  of 


other  minority  groups  than  females  in  the  comparison  group  (84  perceni 
compared  with  62  percent)  and  also  more  likely  to  never  have  been 
married  (94  percent  compared  with  73  percent)  . 

The  Job  Corps  studies  are  among  the  few  we  reviewed  that  did  not 
present  data  on  the  characteristics  of  participants  and  comparison 
group  members  at  various  stages  of  the  evaluation.  Therefore,  we  are 
not  able  to  determine  the  levels  of  childbearing  among  comparison  groi 
women  over  the  study  period.  This  makes  the  fertility  and  family- 
formation  outcomes  of  Job  Corps  particularly  difficult  to  interpret: 
since  the  participant  and  comparison  groups  were  apparently  not 
initially  comparable,  later  differences  may  indicate  the  presence  of 
self-selection  bias.  Other  studies  show  that  more  highly  motivated 
women  tend  to  postpone  childbearing  and  marriage  and  that  the  presence 
of  children  inhibits  program  participation.  The  evaluation  design  use 
for  the  Job  Corps  does  not  allow  one  to  determine  whether  Job  Corps 
participation  actually  induced  delays  in  childbearing  and  family 
formation  (see  Margaret  Simms,  in  this  volume). 

The  differences  in  measured  characteristics  between  Job  Corps 
participants  and  comparison  groups  members  suggest  that  there  may  alsc 
be  differences  in  unmeasured  characteristics  (e.g.,  motivation  and 
aspirations) .  The  possibility  of  self-selection  into  the  program  is  < 
strong  argument  for  the  use  of  a  random  assignment  experimental  desigi 
since  statistical  techniques  may  not  adequately  control  for  the  factoi 
that  determine  program  entry  and  postprogram  outcomes. 


PROGRAM  FOR  IN-SCHOOL  YOUTHS 
New  Youth  Initiatives  in  Apprenticeship 

The  New  Youth  Initiatives  in  Apprenticeship  program  sought  to  pro¬ 
mote  the  use  of  registered  apprenticeship  positions,  outside  the 
construction  trades,  by  developing  linkages  between  the  schools  and 
employers  with  registered  apprenticeship  positions.  Employers  were 
provided  subsidies  for  one-half  of  apprentice  wages,  up  to  a  maximum  c 
$1,700  per  student  apprentice  year. 

The  program  began  operation  in  four  sites  in  1977  under  the  sponst 
ship  of  the  Department  of  Labor's  Bureau  of  Apprenticeship  Training; 
one  of  those  sites  operated  for  only  1  year.  Four  additional  sites 
were  funded  by  the  Office  of  Youth  Programs  in  1978,  bringing  the  tot« 
number  of  sites  operating  in  1978  to  seven.  According  to  the  evaluat: 
(Williams  et  al.,  1981:6):  "The  new  [OYP]  projects  included  targeting 
economically  disadvantaged  students  to  participate  as  student  appren¬ 
tices,  an  activity  not  specifically  mandated  in  the  original  demonstr; 
tion  effort."  Despite  this,  the  data  indicate  that  the  newer  project! 
may  have  been  less  successful  in  enrolling  minorities  than  the  more 
established  projects. 

The  New  Youth  Initiatives  in  Apprenticeship  program  was  reviewed  : 
two  reports.  The  report  by  Williams  et  al.  was  more  comprehensive  ant 
competent,  and  we  based  our  assessment  on  that  report  alone.  The 
follow-up  analysis  was  based  on  samples  of  about  60  0  student- 


apprentices  and  500  matched  comparison  group  members.  The  data  on  the 
student  apprentices  indicate  that  they  were  generally  nonminority  (80 
percent)  and  male  (89  percent)  and  had  a  grade  average  of  B-  in  high 
school  and  a  high  rate  of  graduation  from  high  school  (96  percent)  . 

This  program  does  not  appear,  therefore,  to  have  reached  the  heavily 
disadvantaged  segment  of  the  youth  population.  The  results  of  the 
participant-comparison  group  contrasts  show,  on  average,  small  and  not 
statistically  significant  differences  in  annual  earnings  ($290  above 
the  $10,000  annual  average)  or  wage  rates.  Apprentices  tended  to  be 
more  concentrated  in  machine  trades  occupations  and  comparison  group 
members  in  clerical  and  sales  occupations. 

The  evaluation  study  also  surveyed  several  hundred  employers  of  the 
student  apprentices  in  the  eight  sites  where  the  program  operated.  The 
employer  survey  indicated  that  three-fourths  of  cooperating  employers 
were  small  businesses,  employing  fewer  than  50  workers.  Employers 
appeared  to  be  more  attracted  by  the  screening  and  training  functions 
performed  by  the  program  than  by  the  wage  subsidies  provided.  Employer 
were  predominantly  in  manufacturing  (44  percent)  and  services  (38 
percent);  only  10  percent  had  unionized  work  forces.  A  multivariate 
analysis  indicated  that  the  number  of  apprentices  employed  in  the 
postprogram  period  was  positively  and  significantly  related  to  four 
factors;  the  total  number  of  employees;  being  a  manufacturing  firm; 
being  a  union  firm;  and  the  number  of  years  the  program  had  been  in 
operation  in  the  site.  Though  the  evidence  was  ambiguous,  it  suggested 
that  those  employers  who  rated  stipends  as  important  retained  fewer 
apprentices. 

Two  aspects  of  the  research  design  seem  worthy  of  note.  First,  all 
of  the  postprogram  interviews  were  conducted  in  the  last  six  months  of 
1980,  which  provided  only  6  months  of  post-high  school  data  for  the  40 
percent  of  the  sample  from  the  new  sites  and,  at  most,  1-1/2  years  of 
post-high  school  information  for  14  percent  of  the  group.  With  such  a 
heterogeneous  group  and  relatively  short  follow-up  period,  one  cannot 
be  sure  whether  sufficient  time  had  elapsed  for  program  effects  to 
emerge. 

Second,  the  comparison  group  sample  was  drawn  (after  the  program 
began)  from  the  same  high  schools  as  the  participants.  It  is  natural 
to  question  whether  there  is  some  selection  bias — despite  matching  on 
characteristics — since  the  members  of  the  comparison  group  presumably 
either  had  an  opportunity  to  join  the  apprenticeship  program  and  did 
not  do  so  or  were  specifically  not  chosen  to  participate  in  the 
program.  Since  so  few  significant  findings  emerged  from  the 
participant-comparison  contrasts,  we  did  not  pursue  this  issue  further. 

Because  of  the  characteristics  of  the  participants  we  cannot 
determine  whether  this  type  of  program  might  be  more  effective  among 
more  disadvantaged  youths.  In  addition,  it  is  difficult  to  tell 
whether  the  failure  to  enroll  significant  numbers  of  more  disadvantaged 
youths  is  inherent  in  the  nature  of  the  program  or  simply  due  to  the 
characteristics  of  the  sites  where  it  was  implemented. 

Given  the  character  of  the  participant  population  and  the  nature  of 
the  program,  no  generalizations  can  be  drawn  from  the  evaluation  of  the 


New  Youth  Initiatives  in  Apprenticeship  program  to  youth  employment  ar 
training  efforts  generally. 


CONCLUSIONS 

While  it  would  be  misleading  to  attribute  the  Job  Corps  results  tc 
skills  training  efforts  in  general,  the  measured  effects  of  Job  Corps 
indicate  that  effective  skills  training  can  be  provided  for 
economically  disadvantaged  youths.  At  the  same  time  it  is  clear  on  tfc 
basis  of  both  Job  Corps  and  the  less  effective  New  Youth  Initiatives  i 
Apprenticeship  program  that  the  staff  capacity  and  other  resources 
needed  to  mount  skills  training  efforts  are  not  acquired  quickly  or 
inexpensively. 


6 


Effectiveness  of  Labor  Market 
Preparation  Programs 


The  YE DP A  studies  we  reviewed  represented  three  basic  approaches  to 
labor  market  preparation  for  youths:  (1)  career  exploration  programs, 
vhich  usually  provided  information  on  occupational  opportunities  and 
requirements,  work  habits  and  attitudes,  and  job  search  techniques  and 
sometimes  included  ability  and  interest  testing;  (2)  basic  educational 
skills  training,  usually  remedial,  which  often  included  General 
Equivalency  Diploma  (GED)  preparation;  and  (3)  direct  work  experience, 
asually  combined  with  some  orientation  to  the  "world  of  work."  Most 
programs  offered  some  combination  of  the  first  two  approaches,  and  a 
Eew  were  designed  as  systematic  variations  of  work  and  classroom 
instruction  as  tests  of  their  relative  effectiveness.1 

The  implicit  long-term  goal  of  many  of  the  programs,  especially  the 
programs  focused  on  out-of-school  youths,  was  to  increase  the  employment 
opportunities  and  economic  self-sufficiency  of  youths.  It  was  assumed 
that  certain  deficiencies — in  work  habits  and  attitudes,  basic  educa¬ 
tional  skills,  and  understanding  of  job  interests  and  options — were 
oarriers  for  disadvantaged  youths  in  achieving  economic  self-sufficiency 
and  that  the  correction  of  these  deficiencies  would  solve  the  problem. 
Zorrection  or  amelioration  of  these  deficiencies,  therefore,  became  the 
nterim  objectives  of  the  programs,  as  well  as  steps  toward  the 
Longer-term  employment  goal. 

Labor  market  preparation  programs  under  YEDPA  were  provided  to  both 
in-school  and  out-of-school  youths,  but  the  majority  served  in-school 
youths.  Unfortunately,  most  of  the  studies  on  the  in-school  projects 
iid  not  meet  the  committee's  criteria  of  scientific  evidence  and  so  are 
not  included  in  this  review.  For  example,  we  were  not  able  to  evaluate 
summer  programs  designed  to  maintain  or  improve  educational  skills  of 
youths  over  the  school  vacation  or  the  many  career  exploration  programs 
Dffered  as  a  supplement  to  regular  school  programs.  In  terms  of 
numbers  of  participants,  the  programs  that  met  our  criteria  for 


xIt  is  not  entirely  clear  how  some  programs  should  be  classified, 
particularly  those  that  provided  several  alternative  treatments  (such 
as  the  AYES  project).  We  decided  to  classify  them  here. 
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inclusion  and  are  reviewed  here  largely  involved  out-of-school  youths, 
both  dropouts  and  graduates. 

Several  of  the  reports  reviewed  by  the  committee  indicated  that  th 
programs  being  evaluated,  while  initially  designed  to  provide 
occupational  skills  training,  were  revised  to  offer  more  basic 
educational  and  prevocational  skills.  These  changes  were  necessary 
because  the  youths  enrolled  lacked  the  skills  required  for  more 
specific  vocational  training. 


PROGRAMS  FOR  OUT-OF-SCHOOL  YOUTHS 

Programs  serving  out-of -school  youths  generally  served  both 
dropouts  and  graduates,  though  the  relative  proportions  varied 
considerably  across  the  programs.  We  reviewed  four  programs  for 
out-of-school  youths  that  we  found  deserving  of  mention:  Alternative 
Youth  Employment  Strategies  (AYES)  ,  Recruitment  and  Training  Program 
(RTP)  Career  Exploration  Program,  Project  STEADY  (Special  Training  and 
Employment  Assistance  for  Disadvantaged  Youth)  ,  and  the  Job  Corps 
Educational  Improvement  Effort  (EIE)  .  Table  6.1  details  the 
characteristics  of  each  of  these  programs;  Table  6.2  details  the 
research  design  and  results  of  the  evaluations  of  the  programs. 


Alternative  Youth  Employment  Strategies 

The  Alternative  Youth  Employment  Strategies  (AYES)  project  was 
designed  to  test  the  efficacy  of  three  alternative  models  for  providin 
youth  employment  programs  to  a  particularly  high-risk,  hard-to-reach 
group:  unemployed,  out-of-school  (largely  dropout)  16-  to  21-year-old 
many  referred  by  the  juvenile  and  criminal  justice  systems.  The  model 
treatments  were:  (1)  full-time  work  experience,  with  counseling  and 
placement  services;  (2)  full-time  classroom  instruction  in  basic  educa 
tional,  vocational,  or  prevocational  training,  with  counseling,  ser¬ 
vices;  and  (3)  a  mixed  model  of  part-time  work,  part-time  training, 
counseling,  and  placement.  AYES  was  implemented  using  random 
assignment  at  sites  in  three  cities  (New  York  City,  Miami,  and 
Albuquerque)  and  involved  about  1,100  youths. 

The  Vera  Institute  study  of  AYES  was  of  particularly  high  quality. 
Although  not  free  of  problems,  the  research  seemed  to  have  been 
conducted  as  carefully  as  conditions  permitted,  given  some  problems  of 
implementation.  Its  major  finding  was  that  a  26-week,  full-time 
program  that  concentrated  its  services  on  high-risk  youths  enhanced 
their  chances  of  securing  full-time  employment.  Differences  in  employ 
ment  rates  of  approximately  10  percentage  points  were  found  between 
participants  and  a  randomly  selected  control  group  approximately  8 
months  after  program  participation  (see  discussion  of  Career  Explora¬ 
tion  Program  below).  Positive  effects  were  found  at  all  three  sites: 
the  largest  program  effects  were  found  in  New  York  City  and  the 
smallest  effects  in  Albuquerque.  At  the  same  time,  the  demographic 
nature  of  the  samples  varied  considerably  across  the  sites,  making  it 


TABLE  6.1  Labor  Market  Preparation  Programs  for  Out-of-School  Youths:  Program  Characteristics 
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/irtually  impossible  to  distinguish  the  independent  effects  of 
sthnicity  and  site. 

Differences  in  outcomes  were  not  accompanied  by  any  changes  in  the 
neasured  attitudes  and  orientations  reported  on  a  series  of  tests 
ieveloped  by  the  Educational  Testing  Service  (ETS)  that  were  adminis¬ 
tered  at  the  conclusion  of  the  program.  Nor  did  these  differences  in 
measured  attitudes  affect  the  types  of  jobs  that  participants  obtained, 
rhree  interpretations  are  possibles  (1)  changes  in  reported  orienta¬ 
tions  toward  employment  are  weakly  related  to  changes  in  job-related 
behavior;  (2)  the  tests  were  administered  immediately  after  program 
completion  (when  attrition  rates  were  relatively  lower  for  both  the 
experimental  and  control  groups,  16  and  45  percent,  respectively) 
rather  than  at  8  months  postprogram,  when  the  job  placement  comparisons 
vere  made  (when  attrition  rates  among  the  experimental  and  control 
groups  were  31  and  42  percent,  respectively)  ;  and  (3)  the  tests  them¬ 
selves  may  be  of  questionable  validity  in  measuring  the  attitudes  and 
knowledge  they  purport  to  assess. 

The  Vera  Institute  study  of  AYES  compared  the  relative  effectiveness 
cf  the  three  treatment  strategies  at  each  site.  No  difference  in  the 
effects  of  the  alternative  treatment  strategies  could  be  discerned.  In 
several  other  studies,  similar  null  findings  for  alternative  treatments 
ve re  also  found.  Indeed,  this  is  the  one  finding  that  was  fairly  robust 
throughout  the  studies  of  labor  market  preparation  programs  we  reviewed, 
rhe  only  exception  was  the  Special  Project  for  Indochinese  Youth.  It 
appeared  to  show  English-language  training  for  Indochinese  youths  to  be 
nore  effective  if  based  in  the  classroom  instead  of  in  a  job  context. 

This  null  finding  parallels  a  similar  finding  in  educational 
research  that  shows  little  difference  in  the  employment  effects  of 
/ocational  and  general  education.  Three  explanations  are  possible: 

(1)  the  types  of  instruction  have  equal  effects;  (2)  students  select 
the  type  of  program  best  suited  to  their  needs  (a  choice  among  the 
three  types  of  programs  was  generally  left  to  the  individual) ,  and 
effects  appear  equal  because  each  type  of  instruction  is  provided  to 
that  group  of  students  for  whom  it  is  best  suited;  and  (3)  sample  sizes 
are  too  small  to  detect  small  differences  in  outcomes  controlling  for 
site,  treatment,  and  other  variables. 


RTP  Career  Exploration  Program 

The  Recruitment  Training  Program  (RTP)  Career  Exploration  Program 
provided  summer  instruction  in  career  preparation  to  economically 
3isadvantaged,  unemployed  out-of-school  youths,  both  dropouts  and 
graduates,  in  several  cities.  Services,  including  occupational 
information,  job  search  information,  and  basic  skills  instruction,  were 
provided  to  16-  to  21-year-olds  during  the  summers  of  1979  and  1980. 

The  study  of  RTP  shows  positive  effects  of  the  program.  Partici¬ 
pants  showed  larger  gains  on  a  variety  of  ETS-developed  measures  of  job 
satisfaction  and  vocational  aspiration  than  a  randomly  selected  control 
group.  In  addition,  participants  were  more  likely  to  be  employed  full 
ime  at  program  completion  than  control  group  members,  89  percent 


compared  with  53  percent.  The  favorable  full-time  employment  experience 
of  participants  persisted  at  the  time  of  the  3-  and  8-month  follow-ups 
and  even  increased  slightly:  a  difference  of  7.5  percentage  points  at 
3  months  and  of  8.2  percentage  points  at  8  months. 

The  gains  reported  for  this  less  intensive  summer  program  were  as 
large  as  the  gains  reported  for  the  full  6-month  AYES  program  studied 
by  Vera.  The  findings  could  be  attributed  to  the  fact  that  the  RTP 
Career  Exploration  Program  addressed  a  less  disadvantaged  population: 
approximately  25  percent  of  treatment  and  control  group  members  were 
enrolled  in  college  at  the  3-  and  8-month  follow-ups.  It  is  also 
likely  that  the  assignment  of  youths  to  participant  and  control  groups 
in  the  Career  Exploration  Program  was  not  strictly  random — sizable 
differences  in  the  two  populations  can  be  discerned  on  the  basis  of 
preprogram  characteristics  within  sites,  such  as  high  school  graduation, 
welfare  recipiency,  ethnicity,  and  age  (20  to  30  percent  of  partici¬ 
pants  and  controls  were  20-21  years  of  age)  .  These  considerations, 
combined  with  the  fact  that  the  analysis  takes  no  explicit  account  of 
the  program  year  or  site,  suggests  that  the  findings  in  this  case  are 
not  as  reliable  as  those  from  the  Vera  study. 


Project  STEADY 

Special  Training  and  Employment  Assistance  for  Disadvantaged  Youth, 
Project  STEADY,  operated  during  the  summer  of  1980.  Its  purpose  was  to 
determine  the  feasibility  and  effectiveness  of  the  employment  service's 
local  office  efforts  to  increase  the  employment  and  employability  of 
unemployed  out-of-school  (graduate  and  dropout)  youths  who  had  no 
further  educational  plans  and  no  immediate  employment  prospects. 
Participants,  whose  ages  ranged  from  16  to  21  and  who  were  otherwise 
eligible  for  the  Summer  Youth  Employment  Program,  were  required  to 
participate  35  hours  per  week  at  the  minimum  wage  ($3.10  per  hour)  for 
up  to  12  weeks.  Program  activities  included  aptitude  and  achievement 
testing,  counseling,  labor  market  information,  job  search  training,  and 
referral  to  and  placement  in  unsubsidized  jobs.  Ten  sites  were  selected 
for  the  project.  The  nature  of  the  treatment  varied  considerably 
across  the  sites?  site  directors  had  complete  discretion  in  selecting 
those  services,  materials,  and  emphases  they  thought  most  appropriate. 

The  evaluation  of  Project  STEADY  is  based  on  data  for  approximately 
600  participants  and  400  controls  at  3  months  postprogram.  Data  from  a 
longer  term  follow-up  are  not  available.  Personal  characteristics  of 
both  controls  and  participants  varied  a  great  deal  among  the  sites, 
although  the  initial  assignments  to  control  and  participant  groups 
within  a  site  were  random:  program  applicants  were  initially  tested 
and  then  randomly  assigned  to  participant  and  control  groups.  Attempts 
were  made  to  make  up  for  participant  attrition  by  accepting  control 
group  individuals  as  participants.  The  author  of  the  evaluation  report 
had  no  information  as  to  how  control  group  members  were  selected  to  be 
participants.  In  addition,  attrition  in  the  3-month  follow-up  period 
was  significantly  higher  among  control  group  members  (about  one-third) 
compared  with  participants  (one-fifth) . 


System  (SAS)  as  appropriate  to  both  the  target  population  and  the 
program  objectives:  job-holding  skills  and  job-seeking  skills.  Both  a 
pretest  and  a  posttest  consisting  of  the  two  SAS  measures  were  adminis¬ 
tered  to  the  participants  and  controls.  Performance  outcome  measures 
were  used  in  a  program  completion  survey  administered  to  participants 
after  12  weeks  of  program  participation  and  in  a  control  group  status 
survey  administered  to  controls  at  the  same  time.  In  addition, 
performance  outcome  measures  were  used  in  follow-up  surveys  (3  months) 
after  termination  of  program  participation  for  participants  and  at  the 
same  time  for  controls.  Information  on  individual  characteristics  of 
participants  and  controls  was  taken  from  the  individual  participant 
profile  of  SAS. 

There  were  relatively  small  numbers  of  participants  and  controls  at 
any  given  site.  Alternative  statistical  tests  were  used  to  gauge  the 
effectiveness  of  Project  STEADY.  Statistically  significant  gains  for 
participants  relative  to  controls  were  found  in  both  job-holding  skills 
and  job-seeking  skills  when  sites  were  pooled.  However,  on  an 
individual-site  basis,  only  2  of  10  sites  revealed  statistically 
significant  gains  for  participants  relative  to  controls  in  job-holding 
skills  and  job-seeking  skills.  At  most  of  the  remaining  sites,  the 
gains  of  participants  relative  to  controls  were  not  statistically 
significant. 

The  3-month  follow-up  survey  revealed  that  when  all  sites  were 
pooled,  the  percentage  of  participants  who  were  employed  full  time 
exceeded  that  of  the  controls  by  a  large  and  statistically  significant 
amount:  the  adjusted  probabilities  of  full-time  employment  are 
estimated  to  be  29  and  17  percent  for  participants  and  controls, 
respectively.  On  an  individual-site  basis,  only  the  three  sites  with 
large  samples  exhibited  statistically  significant  full-time  employment 
differences,  all  in  favor  of  participants.  The  percentage  of  par¬ 
ticipants  reporting  being  employed  in  jobs  of  higher  status  exceeded 
that  of  the  controls  by  a  statistically  significant  amount  when  pooling 
all  sites.  On  an  individual-site  basis,  however,  there  were  no 
statistically  significant  differences  in  job  status.  There  were  also 
no  significant  differences  in  earnings  or  in  job  satisfaction  between 
participants  and  controls. 

After  adjusting  for  heterogeneity  between  the  participant  and 
control  groups  at  the  3-month  survey,  the  evaluators  found  that  of  the 
40  possible  outcomes  included,  10  yielded  statistically  significant 
differences,  all  in  favor  of  participants  (relative  job  status  was  no 
longer  significantly  different) .  These  outcomes  included  full-time 
employment,  financial  contribution  to  one's  family,  two  measures  of 
future  job  quality,  and  getting  along  with  one's  family. 

Very  little  information  pertaining  to  race,  sex,  or  age  differences 
in  program  gains  is  available  from  the  evaluation  of  Project  STEADY.  A 
multiple  regression  analysis  was  conducted  in  which  posttest  scores 
were  regressed  on  pretest  scores  and  demographic  characteristics.  For 
all  sites  taken  together,  females  experienced  statistically  significant 
smaller  gains  than  males  in  both  job-holding  and  job-seeking  skills. 
Practically,  however,  these  meant  small  actual  differences  in  scores. 


On  the  other  hand,  there  were  no  statistically  significant  diffe] 
by  race  and  age. 

There  were  certain  implementation  problems  associated  with  P] 
STEADY  as  a  demonstration  project  that  need  not  occur  under  a  pei 
program.  Due  to  the  brief  start-up  time,  there  was  difficulty  ii 
recruiting  participants.  Lack  of  time  and  resources  caused  diff: 
regarding  planning,  curriculum  development,  and  the  necessary  ou- 
to  potential  participants,  as  well  as  the  creation  of  a  true  coni 
group  (as  discussed  above) . 

Overall,  the  evidence  indicates  some  positive  effects  of  Pro; 
STEADY  on  the  short-term  employment  prospects  of  youths.  While  1 
precision  of  the  estimated  gains  is  questionable  because  of  data 
ficulties,  the  qualitative  effects  can  probably  be  accepted.  Ho\ 
statistical  significance,  where  found,  was  typically  the  result  < 
pooling  the  data  across  sites,  and  therefore  we  have  questions  al 
whether  the  evaluation  of  Project  STEADY  demonstrated  that  the  p: 
could  have  a  substantial  positive  impact  on  a  significant  number 
young  people  facing  employment  difficulties. 


Job  Corps  Educational  Improvement  Effort 

The  purpose  of  the  Educational  Improvement  Effort  (EIE)  was 
improve  the  educational  offerings  of  Job  Corps  to  provide  corps  i 
with  the  best  opportunities  for  learning  at  all  levels.  To  meet 
objectives,  new  or  revised  curricula  were  developed  for  basic  sk. 
reading  and  mathematics  and  high  school  level  skills  in  all  area 
Programs  were  tested  in  an  experimental  design  to  provide  inform, 
concerning  their  effects  on  educational  progress  and  process  (Ar< 
et  al.,  1982).  The  Job  Corps  Educational  Improvement  Effort  (EL 
noteworthy  in  its  attempt  to  use  random  assignment  of  Job  Corps 
ticipants  to  treatment  and  control  groups  to  test  alternative  te. 
techniques. 

The  programs  evaluated  included:  (1)  a  reading  curriculum  t 
used  materials  revised  from  earlier  Job  Corps  reading  programs; 
calculator  mathematics  program  that  provided  instruction  and  exp 
in  the  use  of  hand-held  calculators;  (3)  a  reading  program  using 
aides"  to  help  instructors  in  the  reading  program  deal  with  the 
tional  needs  of  their  students;  (4)  a  program  offering  participa: 
opportunity  to  obtain  a  regular  high  school  diploma  rather  than 
(5)  a  GED  program  that  used  televised  instruction;  (6)  a  compute 
assisted  education  program  using  the  Comprehensive  Computer  Prog 
help  students  with  reading  and  mathematics;  (7)  the  PLATO  system 
computer-assisted  instruction;  (8)  two  curriculums  to  help  stude 
with  learning  disabilities — one  developed  by  the  University  of  F 
and  the  second  by  the  University  of  Kentucky;  and  (9)  two  curric 
designed  to  improve  the  "employability  skills"  of  participants, 
Adkins  Employability  Skills  Series  Program  and  the  American  Prep 
Institute  Program. 


Over  7,000  Job  Corps  members  in  11  centers  took  part  in  one  or  more 
of  these  programs.  Because  participants  could  enter  or  leave  the 
program  at  any  time,  attrition  in  posttest  data  was  substantial  for 
many  treatments  and  sites:  for  example,  74  percent  among  controls  in 
the  mathematics  component  of  the  Comprehensive  Computer  Program  model 
(Argento  et  al.,  1982:Table  1.4-1). 

The  assignment  of  participants  to  treatment  and  control  groups  is 
described  as  follows  (Argento  et  al.,  1982:1-5): 

Potential  participants  were  randomly  assigned  to  either  the 
experimental  group  or  the  control  group,  to  the  extent  possible. 
Unfortunately  random  selection  was  not  always  possible.  In  one 
large  Job  Corps  Center,  for  example,  a  decision  was  made  to 
place  all  students  in  the  same  vocational  training  area  in  the 
same  educational  classes.  Thus  all  students  interested  in 
automobile  mechanics  were  in  one  mathematics  class,  all  those 
interested  in  nursing  in  another,  and  so  on.  With  this  system, 
it  was  impossible  to  maintain  true  randomization.  .  .  . 

While  the  report  is  forthright  about  such  problems,  it  does  not  present 
separate  analyses  for  the  "true"  random  assignments,  and  so  it  is  not 
possible  to  estimate  the  biases  that  might  have  been  introduced  by  such 
administrative  decisions  to  abandon  randomization  at  some  sites. 

The  key  analysis  performed  for  each  of  the  programs  uses  preprogram 
to  postprogram  differences  in  Stanford  Achievement  Test  (SAT)  scores  as 
the  dependent  variable  in  an  analysis  of  covariance  in  which 
"treatment"  is  the  independent  factor  and  the  covariates  include  sex, 
age,  race/ethnicity,  highest  grade  completed  in  school,  hometown  size, 
whether  family  receives  welfare,  and  score  on  SAT  pretest.  The 
reported  analyses  do  not  consistently  include  all  variables,  apparently 
because  a  stepwise  inclusion  procedure  was  used. 

Gains  in  test  scores  are  measured  in  "grade  equivalent"  years  in 
order  to  gauge  treatment  effects  on  educational  attainment.  Thus, 
postprogram  minus  preprogram  scores  are  divided  by  the  number  of  hours 
in  the  program:  a  100-hour  program  that  raised  performance  by  two 
grades  would  show  a  gain  of  2/100,  or  .02.  Gain  scores  are  then 
adjusted  for  the  covariates  included  in  the  analysis. 

Few  of  the  treatments  produced  significant  results;  for  those  that 
do  appear  significant  selectivity  bias  cannot  be  ruled  out  as  an 
important  factor.  Thus,  we  did  not  find  the  evidence  on  the  differ¬ 
ential  effectiveness  of  the  Job  Corps  EIE  convincing. 


PROGRAMS  FOR  IN-SCHOOL  YOUTHS 

This  section  discusses  three  programs  that  predominantly  or 
exclusively  served  in-school  youths:  the  Career  Exploration  Program; 
the  School-to  Work  Transition  program,  and  Project  Redirection.  Table 
6.3  details  program  characteristics;  Table  6.4  presents  the  research 
design  and  results  of  the  program  evaluations. 


Labor  Market  Preparation  Programs  for  In-School  Youths: 
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selected  subgroups 


OIC/A  Career  Exploration  Program 


The  Opportunities  Industrialization  Centers  of  America,  Inc. 

(OIC/A)  operated  the  Career  Exploration  Program  in  seven  sites  during 
1980.  The  design  of  the  OIC/A  program  was  similar  in  many  respects  to 
that  of  programs  offered  by  RTP  and  other  community-based  organizations; 
it  involved  a  10-week  summer  program  providing  classroom  instruction 
for  2  hours  per  day  and  career  exposure  site  experience  (work  experi¬ 
ence)  for  4  hours  per  day.  A  follow-up  component  extended  for  8  months 
after  the  summer  program  and  included  review  classes,  counseling, 
referral  services,  and  a  newsletter  designed  to  reinforce  skills 
learned  in  the  program. 

The  OIC/A  program  served  a  predominantly  minority  clientele  (78 
percent  black,  13  percent  Hispanic)  of  16-  to  21-year-olds;  nearly  half 
of  the  participants  were  female  (48  percent)  .  Because  an  express  aim 
of  the  program  was  to  serve  high-risk  youths,  about  24  percent  of  the 
participants  were  ex-offenders  and  19  percent  were  dropouts;  75  percent 
of  the  participants  were  high  school  students,  4  percent  were  graduates, 
and  1  percent  had  received  GED  degrees.  No  data  were  provided  on 
cross-site  differences  in  participant  characteristics. 

While  participant  and  control  group  members  were  similar  in  terms 
of  age  and  economic  status,  they  differed  significantly  in  other 
preprogram  characteristics.  Participants  were  more  likely  to  be  female 
(48  percent  of  participants  compared  with  37  percent  of  controls) ; 
attending  high  school  (75  percent  compared  with  68  percent)  ,  and  black 
or  Hispanic  (90  percent  compared  with  84  percent)  .  By  design,  controls 
were  more  likely  to  be  youth  offenders  than  were  participants,  though 
the  actual  proportions  differed  from  the  planned  50  percent  and  33 
percent:  49  percent  of  controls  were  offenders  while  only  24  percent 
of  participants  were. 

The  differences  between  the  two  groups  suggest  that  random  assign¬ 
ment  was  not  strictly  followed,  at  least  at  some  of  the  sites,  and  the 
evaluation  report  itself  suggests  as  much.  While  overall  attrition  at 
8  months  was  reasonable  for  studies  of  this  kind  (23  percent  for  par¬ 
ticipants  and  20  percent  for  controls) ,  differential  attrition  among 
black  participants  eliminated  the  significant  difference  in  racial 
composition  that  had  existed  earlier  between  the  experimental  and 
control  groups. 

The  evaluation  results  indicate  that  the  participants'  school 
attendance  improved  and  their  criminal  recidivism  was  reduced  at  3  and 
8  months  postprogram  compared  with  a  randomly  assigned  control  group. 

The  analysis  by  the  Center  for  Studies  in  Social  Policy  of  the  data  for 
nearly  1,500  participants  and  800  controls  at  8  months  postprogram 
indicates  that  continued  school  attendance  was  significantly  higher  for 
participants  than  controls:  73  percent  compared  with  62  percent. 

Given  the  initial  differences  between  the  two  groups  on  school  and 
offender  status,  however,  and  the  fact  that  being  in  school  at  program 
entry  was  found  to  be  positively  associated  with  being  in  school  at  the 
follow-up,  it  may  not  be  surprising  that  participants  compare  favorably 
with  controls  on  this  measure.  Because  it  is  not  clear  that  random 
assignment  was  effectively  carried  out  and  the  results  are  confounded 


/ith  preprogram  characteristics,  it  may  be  erroneous  to  treat 
postprogram  differences  as  program  outcomes. 


National  Puerto  Rican  Forum 

The  National  Puerto  Rican  Forum's  (NPRF)  School- to-Work  Transition 
urogram  was  designed  to  serve  approximately  150  (largely)  Puerto  Rican 
Ln-school  youths  in  each  of  various  sites  to  "enable  the  participants 
:o  better  understand  and  identify  their  strengths  and  weaknesses, 
Eacilitate  the  transition  from  school  to  work,  and  enhance  their 
ibility  to  select  a  career"  (Murphy  and  Appel,  1981:13).  Services  were 
intended  to  include  workshops  in  self-awareness,  preemployment  skills, 
md  job  exploration  for  5  hours  per  week  during  the  school  year. 

Actual  contact  hours  averaged  fewer  than  30  in  each  site. 

In  the  initial  year  of  the  program,  1979,  services  were  provided  to 
ligh  school  seniors  attending  two  schools  in  each  of  three  sites, 
Chicago,  Jersey  City/Hoboken,  and  New  York  (South  Bronx) .  In  the 
following  year,  apparently  due  to  a  concern  that  many  needy  Puerto 
*ican  youths  leave  school  before  senior  year,  the  program  shifted  its 
Eocus  to  serving  high  school  freshmen,  lost  one  of  the  Jersey  City 
schools,  and  added  four  high  schools,  two  in  Hartford  and  two  in  San 
Tuan. 

Because  of  the  program's  focus  on  high  school  seniors,  it  may  be 
appropriate  to  view  the  1979  program  as  similar  to  job  placement 
efforts  (such  as  Jobs  for  Delaware  Graduates  or  Project  BEST,  discussed 
Ln  Chapter  9) .  As  such,  the  nature  of  the  comparison  group  and  the 
relative  experiences  of  the  two  groups  become  important.  While 
Initially  based  on  an  experimental  design,  random  assignment  was 
abandoned  due  to  insufficient  sample  sizes,  and  all  youths  expressing 
an  interest  in  the  program  were  allowed  to  participate.  Comparison 
jroup  members  were  high  school  seniors  from  the  same  schools  as 
participants.  No  information  is  available  on  the  procedures  used  to 
select  comparison  group  members,  who  differed  considerably  from 
participants:  comparison  group  members  included  fewer  Hispanics  and 
nore  blacks,  had  higher  family  economic  status,  and  had  less  prior 
imployment. 

Attrition  among  both  participant  and  comparison  group  members  at 
:he  8-month  follow-up  (50  and  62  percent,  respectively)  was  par¬ 
ticularly  high  for  participants  who  were  Hispanic  and  from  low  economic 
status  households,  while  attrition  among  comparisons  was  highest  for 
clack  males.  Due  to  the  attrition  pattern,  the  initial  differences  in 
characteristics  between  the  two  groups  largely  disappeared.  Moreover, 
the  resulting  sample  sizes,  102  participants  and  130  comparisons,  were 
Inadequate  for  reliable  quantitative  analysis.  Therefore,  no  valid 
Inferences  can  be  drawn  about  the  effectiveness  of  the  1979  NPRF 
program. 

The  program  that  operated  during  the  1980-1981  academic  year  served 
ligh  school  freshmen  for  an  average  of  33  contact  hours  during  the 
school  year  (Trismen,  1982).  About  83  percent  of  participants  were 
iispanic,  57  percent  were  female,  and  85  percent  were  from  families 


with  incomes  no  higher  than  70  percent  of  the  lower  living  standard  of 
the  Bureau  of  Labor  Statistics.  While  no  information  is  provided  on 
how  comparison  group  members  were  chosen,  the  demographic  character¬ 
istics  of  the  comparison  group  very  closely  matched  those  of  partici¬ 
pants.  Participants  and  comparisons  in  the  second  year  program  were, 
of  course,  younger  than  those  who  participated  the  previous  year;  they 
were  also  of  lower  economic  status,  had  less  prior  employment  experi¬ 
ence,  and  scored  lower  on  pretests  on  a  variety  of  cognitive  measures. 

At  program  exit,  participants  exhibited  significantly  larger  gains 
than  did  comparisons  on  each  of  the  seven  items  in  the  SAS  test 
battery.2  This  is  in  contrast  to  a  finding  of  no  significant 
differences  in  gains  for  participant  and  comparison  group  members 
during  the  previous  year's  program. 

Postprogram  results  are  available  only  at  3  months  after  program 
completion  for  61  percent  of  participants  (260)  and  65  percent  of 
comparison  group  members  (302) .  Statistically  significant  findings 
that  favored  the  participant  group  related  to  the  degree  of  job 
knowledge,  the  proportion  working  full  time  or  part  time  (40  percent 
and  29  percent) ,  and  the  extent  to  which  family  members  felt  good  about 
the  program  (or  "how  you've  been  doing"  for  controls).  As  seems 
appropriate  for  a  program  serving  in-school  youths,  the  employment 
outcome  largely  reflects  part-time  employment. 

At  the  time  of  the  3-month  follow-up  in  early  fall  of  1981,  about 
86  percent  of  the  respondents  were  in  school.  While  participants  were 
significantly  less  likely  to  be  in  school  at  the  follow-up  than 
comparison  group  members,  other  things  equal,  the  actual  difference  was 
small;  85  percent  compared  with  87  percent.  Overall,  participants  in 
the  1980-1981  program  performed  significantly  better  immediately 
postprogram  than  nonparticipants  on  a  variety  of  cognitive  measures. 
Three  months  postprogram,  participants  were  somewhat  more  likely  than 
comparisons  to  be  employed  full  time  (2  percent  compared  with  1 
percent)  and  much  more  likely  to  be  employed  either  part  time  or  full 
time  (40  percent  compared  with  29  percent)  ,  but  they  were  also  somewhat 
less  likely  than  comparison  group  members  to  be  enrolled  in  school. 

Thus  whether  the  program  intended  to  or  not,  it  did  not  increase  school 
retention.  Although  the  evaluation  of  the  1980-1981  NPRF  program 
provided  promising  results,  it  provided  insufficient  information  on  how 
the  comparison  group  was  formed.  Therefore,  we  cannot  be  confident 
about  the  results  for  either  year  of  the  NPRF  program's  operation. 


2 Gains  were  measured  in  terms  of  percentages  of  standard  deviations, 
and  the  magnitudes  averaged  34-65  percent  across  all  sites  (Murphy  and 
Appel,  1981).  Gains  of  10  percent  or  more  were  considered  to  have 
practical  significance. 


Project  Redirection 


Project  Redirection  was  designed  to  provide  pregnant  and  parenting 
/omen  aged  17  and  younger  who  had  not  yet  graduated  from  high  school 
/ith  educational,  health,  family  planning,  and  employment— related 
>ervices  for  up  to  18  months.  Its  goal  was  long-term  personal  and 
iconomic  self-sufficiency.  It  operated  in  four  sites — Boston,  New  York 
(Harlem),  Phoenix,  and  Riverside  (California) — from  mid-1980  to  1983. 
\bout  48  percent  of  participants  were  black,  38  percent  were  Hispanic, 
ind  13  percent  non-Hispanic  whites.  The  average  age  of  participants 
/as  16,  56  percent  were  pregnant  (not  yet  parents),  and  52  percent  were 
Ln  school  at  the  time  of  the  baseline  interview. 

Project  Redirection  was  noteworthy  for  its  development  of  a 
comprehensive  program  of  counseling  and  supportive  services  for  young 
omen  from  low-income  backgrounds  who  were  pregnant  or  mothers.  While 
-he  program  seemed  innovative  and  promising,  the  evaluation  findings 
ire  unclear.  The  interim  report  on  program  effectiveness  considered 
ibout  180  participants  and  200  comparisons  at  only  12  months  after 
snrollment  in  the  program,  when  most  young  women  were  still  partici¬ 
pating  or  had  only  recently  left  the  program.  The  findings  indicated 
:hat  participants  were  less  likely  to  have  a  repeat  pregnancy  (17 
percent  compared  with  22  percent)  and  more  likely  to  be  enrolled  in 
school  or  have  completed  school  or  a  GED  program  (66  and  50  percent, 
respectively) . 

However,  a  later  report  at  24  months  after  enrollment  in  the 
program  showed  Project  Redirection  youths  on  the  whole  fared  no 
Jifferently  than  comparison  group  youths  on  a  variety  of  outcomes. 

Phere  were  no  significant  differences  in  the  number  of  repeat 
regnancies,  in  school  enrollment  or  completion,  or  in  employment. 

While  the  evaluation  design  of  Project  Redirection  was  superior  to 
:hat  of  other  programs  for  pregnant  and  parenting  youths,  several 
shortcomings  limit  our  confidence  in  the  findings.  The  comparison 
jroup  approach  used  matched  sites  in  the  same  regions,  but  several 
significant  differences  between  comparison  and  participant  group 
nembers  at  baseline  suggest  that  the  two  groups  were  not  comparable. 
por  example,  controls  were  more  likely  to  be  attending  school  (70 
percent  compared  with  52  percent),  had  had  more  pregnancies,  and  had 
previously  enrolled  in  a  teen  parent  program  (44  percent  compared  with 
>3  percent) .  Attempts  to  adjust  for  selectivity  bias  produced  no 
lifference  in  the  results. 

In  addition,  the  comparison  group  members  received  many  of  the  same 
services  provided  to  participants  in  Project  Redirection.  Thus,  rather 
:han  being  a  test  of  the  effect  of  providing  services,  per  se,  the 
lemonstration  is  more  appropriately  seen  as  the  test  of  the  relative 
effect  of  the  Project  Redirection  service  provision  strategy  compared 
/ith  others.  The  possibility  therefore  exists  that  the  results 
inderstate  the  true  program  effects. 

In  order  to  enlarge  the  participant  sample  by  nearly  one-half  (from 
-80  to  350  participants) ,  a  second  sample  was  formed  with  treatment 
froup  members  who  participated  in  the  program  between  March  1981  and 
ranuary  1982,  about  a  year  after  the  original  sample  members  were  given 
>aseline  interviews.  They  were  added  to  the  analysis  along  with 
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TABLE  6.5  Selected  Project  Redirection  Outcome  Differences 


First 

Second 

Outcome 

Sample 

Sample 

Percentage  with  pregnancy 
subsequent  to  baseline 
at  12-month  interview 

-  9* 

-  8 

at  24-month  interview 

-  7 

+  2 

Percentage  with  live  birth 
subsequent  to  baseline 
at  24-month  interview 

-  9 

-  2 

Percentage  ever  enrolled 
in  school  between  baseline 

and  24-month  interview 

+11* 

+25* 

Percentage  employed  at 

24-month  interview 

+  1 

-  4 

NOTE:  Adjusted  participant  group  mean  minus  comparison  group  mean. 

*Statistically  significant  at  the  .05  level  or  below  in  a 
two-tailed  test. 

SOURCE:  Polit  et  al.  (1985). 


additional  comparison  group  members.  The  numbers  of  additional  sample 
members  were  not  uniform  across  the  sites.  Various  techniques  were 
used  to  overcome  the  lack  of  comparable  baseline  data  for  members  of 
the  second  sample,  including  the  use  of  retrospective  data  and 
estimation. 

The  data  for  the  two  samples  are  pooled  in  most  of  the  analyses 
even  though  the  treatment  period  covered  different  time  periods  (and 
therefore  possibly  somewhat  different  program  offerings)  and  members  of 
the  second  sample  participated  for  a  significantly  shorter  period  of 
time,  9.9  compared  with  12.9  months.  The  pooling  of  the  two  samples 
may  account,  in  part,  for  the  apparent  decline  in  program  effects 
between  the  12-month  and  24-month  results.  The  interim  report  results 
rely  exclusively  on  data  from  the  initial  sample  while  the  24-month 
results  include  data  from  the  second  sample,  which  account  for  a 
significant  share  (40  percent)  of  the  total.  When  results  at  24  months 
are  reported  separately  for  the  two  samples,  participant  outcomes  for 
the  first  sample  are  generally  more  favorable  with  respect  to  the 
comparison  group  than  those  of  the  second  samples  for  example,  outcome 
are  better  in  terms  of  the  number  of  repeat  pregnancies,  the  number  of 
live  births,  whether  the  participant  is  employed,  and  a  variety  of 
other  measures  (see  Table  6.5). 


135 


Although  the  overall  attrition  rate  of  14  percent  for  the  first 
sample  was  relatively  low  for  a  study  covering  2  years,  there  was 
significantly  more  attrition  among  participants  (21  percent)  than  among 
comparison  group  members  (7  percent) .  Attrition  rates  for  members  of 
the  second  sample  are  more  problematic:  only  55  percent  of  those  who 
participated  were  given  the  24-month  interview.  Attempts  to  adjust  for 
attrition  bias  using  the  Heckman  (1979)  procedure  produced  no  changes 
in  estimated  program  effects,  although  this  was  as  likely  due  to  the 
difficulty  of  modeling  attrition  as  to  any  other  explanation.3 

Finally,  due  to  the  nature  of  the  sample  design,  site  effects  are 
confounded  with  race/ethnicity  effects.  The  Harlem  site  was  largely 
black  (92  percent)  ,  Boston  was  predominantly  Puerto  Rican  (96  percent) , 
and  Phoenix  and  Riverside  were  the  only  sites  with  white  non-Hispanic 
participants  (9  and  40  percent,  respectively)  and  with  significant 
numbers  of  Mexican-American  participants  (42  and  24  percent, 
respectively) . 

Because  of  the  many  methodological  difficulties  inherent  in  the 
evaluation,  we  do  not  believe  that  reliable  conclusions  about  the 
effectiveness  of  Project  Redirection  can  be  drawn. 


CONCLUSION 

Programs  offering  labor  market  preparation  were  the  largest  single 
category  of  programs  we  reviewed.  Although  15  reports  met  the  com¬ 
mittee's  standards  of  evidence  for  determining  program  effectiveness, 
many  suffered  from  serious  methodological  deficiencies  that  led  to 
questions  about  their  results. 

The  results  of  several  studies  (mostly  of  programs  for  out-of- 
school  youths)  were  of  sufficient  reliability  to  be  examined  for  their 
implications  for  youth  policy:  the  Alternative  Youth  Employment 
Strategies  (AYES)  project,  some  career  exploration  programs  (those 
operated  by  OIC/A  and  RTP,  in  particular) ,  and  Project  STEADY. 

Overall,  the  results  of  these  studies  suggest  that  most  labor 
market  preparation  programs  for  out-of-school  youths  have  at  best  only 
marginal  effects  on  employment,  and  there  is  some  hint  that  the  effects 
may  decay  fairly  rapidly  (3  to  8  months)  after  participants  leave  the 
program.  A  comparison  of  the  26-week  program  with  programs  of  10  to  12 
weeks  suggests  that  the  same  marginal  gains  in  employment  can  be 


3 As  a  practical  matter,  it  is  when  the  use  of  these  techniques 
produces  change  in  the  estimated  results  that  the  presence  of  selection 
bias  is  indicated.  When  selection  bias  adjustment  techniques  produce 
no  change  in  the  estimates,  it  can  either  be  due  to  the  absence  of 
selection  bias  or  the  inability  to  properly  identify  the  factors  that 
differentiate  participants  from  nonparticipants.  Thus,  when  the 
application  of  these  techniques  produces  no  change  in  the  estimated 
effects,  it  implies  nothing  about  the  presence  or  absence  of  selection 
bias. 


achieved  as  well  by  a  shorter  program,  although  differences  in  targ 
group  characteristics  and  treatments  suggest  caution  in  generalizin 
this  particular  finding.  The  effects  of  the  programs  on  job  attitu 
and  orientation,  if  reliably  measured,  are  also  marginal.  The  lack 
a  relationship  between  these  measures  and  employment  gains  raises 
interesting  issues  about  the  goals  of  these  programs  (many  of  which 
were  supposed  to  have  focused  on  changing  youths'  attitudes  and 
motivations)  about  attitude  measurement,  and  about  the  relation  of 
attitudes  to  employment. 

The  results  of  these  studies  raise  many  other  interesting  quest 
that,  unfortunately,  we  cannot  answer  because  of  deficiencies  in  th 
research.  Programs  were  operated  in  many  sites,  with  variations  in 
program  approach  and  target  group  characteristics,  but  when  the  dat 
were  analyzed  and  the  results  presented,  those  differences  were  not 
examined,  often  because  of  insufficient  sample  sizes.  Across  and 
within  sites,  different  groups  of  participants  received  similar 
services,  perhaps  with  varying  effects,  but  again  most  evaluations 
not  include  separate  analyses:  for  instance,  for  in-school  compare 
with  out-of-school  youths;  for  dropouts  compared  with  high  school 
graduates;  for  males  compared  with  females;  or  by  race  and  ethnic 
subgroups.  When  a  program  has  an  effective  outcome,  we  know  little 
about  why  it  works  or  for  whom.  Similarly,  when  there  is  no  effect 
no  difference  in  effect,  as  in  the  AYES  project,  we  cannot  identify 
reasons  for  the  particular  finding.  Yet  such  information  would  hel 
identify  possible  effective  approaches  to  youth  employment  problems 

Many  of  the  labor  market  preparation  studies  produced  by  the  YE 
knowledge  development  effort  are  not  discussed  in  this  report  becau 
we  found  their  methodological  deficiencies  too  serious  to  allow  rel 
interpretations  of  their  results.  The  most  common  shortcomings  in 
these  evaluations  were  the  inadequacy  of  the  control  or  comparison 
groups  and  sample  attrition.  In  most  cases,  the  "control"  group  wa 
sufficiently  different  from  the  participant  group  in  important  char 
acteristics  that  there  was  reason  to  suspect  differences  in  unmeasu 
characteristics  as  well,  which  makes  the  attribution  of  changes  in 
outcomes  as  due  to  the  program  questionable.  In  many  other  cases, 
although  a  requirement  for  random  selection  was  stated  as  a  planned 
feature  of  the  research  design,  the  randomization  of  participants  a 
controls  was  abandoned,  in  still  other  cases,  the  comparison  group 
consisted  of  participants  in  another  program,  resulting  in  probable 
underestimates  of  program  effects  relative  to  those  based  on  a  trul 
untreated  control  group.  Appropriate  techniques  for  following  up 
program  participants  and  comparison  group  members  were  rarely  used. 
Not  only  was  attrition  in  the  3-  to  8-month  period  following  progra 
completion  often  in  excess  of  one-third,  but  differential  patterns 
attrition  raised  serious  questions  about  the  validity  of  purported 
results. 


7 

Effectiveness  of  Temporary 
Jobs  Programs 


Programs  providing  temporary  subsidized  employment  have  been  a 
mainstay  of  youth  employment  and  training  efforts  in  the  United  States 
since  the  War  on  Poverty.  The  committee  reviewed  five  reports  on  YEDPA 
programs  that  provided  temporary  jobs  for  youths.  Three  served 
out-of-school  youths  exclusively:  Ventures  in  Community  Improvement 
(VICI) /  Supported  Work,  and  the  Public  Versus  Private  Sector  Jobs 
Demonstration  Project.  Two  were  designed  primarily  for  in-school 
youths:  the  Summer  Youth  Employment  Program  (SYEP)  and  the  Youth 
Incentive  Entitlement  Pilot  Projects  (YIEPP) . 

PROGRAMS  FOR  OUT-OF-SCHOOL  YOUTHS 

Table  7.1  presents  the  characteristics  of  the  three  programs 
serving  out-of-school  youths.  Table  7.2  summarizes  the  research  design 
and  results  of  the  evaluations  of  those  programs. 


Ventures  in  Community  Improvement 

Ventures  in  Community  Improvement  was  a  demonstration  project 
operated  under  the  Youth  Community  Conservation  and  Improvement 
Projects  (YCCIP)  part  of  YEDPA.  The  target  population  consisted  of 
youths  aged  16-19  who  were  out  of  school,  had  employment  difficulties, 
or  were  economically  disadvantaged  (eligible  for  CETA) .  The  program 
provided  participants  with  up  to  12  months  of  work  experience  (on 
average,  participants  stayed  for  6  months)  on  construction  projects  to 
improve  public  or  low- income  housing.  Participants  were  supervised  by 
union  journeymen  at  a  ratio  of  6  to  1.  Job  placement  assistance  was 
provided  to  those  completing  the  program,  and  participants  were  actively 
encouraged  to  complete  a  General  Equivalency  Diploma  (GED)  program. 

One  objective  of  the  project  was  to  determine  the  impact  of  the  program 
on  participants'  subsequent  labor  market  outcomes.  Other  objectives 
were  to  test  the  feasibility  of  replicating  the  program  model  on  a 
broader  scale  and  to  find  a  way  to  measure  the  value  of  the  community 
housing  improvements  produced  under  the  program.  In  all,  there  were 
eight  sites  involving  a  total  of  1,500  participants.  The  demonstration 
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Temporary  Jobs  Programs  for  Out-of-School  Youths 
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aBased  on  long-term  follow-up  survey  up  to  4-1/2  years  after  enrollment  (see  Maynard  et  al.,  1982). 

^Results  are  presented  for  total  sample  and  for  those  who  completed  the  program.  Since  attrition  in  the  total  sample  is  high  (57%)  only  the 
results  of  program  completers  are  reported  here. 


was  implemented  between  September  1978  and  February  1979  and  concluded 
in  all  sites  in  September  1980. 

Comparison  groups  were  derived  from  three  sources:  participants  i 
YCCIP  programs  run  by  the  Department  of  Housing  and  Urban  Development 
(HUD;  operating  under  an  interagency  agreement  with  the  Department  of 
Labor)  in  four  sites  that  overlapped  VICI;  youths  in  formula-funded 
YCCIP  construction  programs  in  three  sites;  and  youths  randomly  select 
from  VICI  waiting  lists  after  the  programs  were  fully  enrolled  with 
youths  judged  to  be  the  most  motivated.  According  to  the  evaluation 
report,  objections  raised  by  the  Department  of  Labor  and  a  pressing 
need  to  launch  the  VICI  project  without  further  delay  were  cited  as  th 
reasons  for  not  following  a  true  randomized  evaluation  design.  Unfor¬ 
tunately,  few  detailed  data  on  participants  in  non-VICI  programs  are 
provided  and  no  data  are  provided  on  comparison  group  members  drawn 
from  the  VICI  waiting  lists. 

Postprogram  follow-up  data  were  obtained  from  interviews  adminis¬ 
tered  to  comparison  groups  as  well  as  the  VICI  participants  at  1  month 
3  months,  and  8  months  postprogram.  Final  samples  used  for  estimating 
effects  varied  from  160  to  500  VICI  participants  and  from  160  to  650 
comparison  group  members. 

Although  long-term  program  effects  could  not  be  estimated,  the 
statistically  significant  estimated  short-term  effects  of  VICI  relativ 
to  individuals  drawn  from  VICI  waiting  lists  were  (1)  an  increased 
probability  of  employment;  (2)  an  increased  probability  of  being  in  an 
apprenticeship  position  or  on  an  apprenticeship  waiting  list;  and  (3) 
higher  quarterly  earnings  (a  maximum  of  $1,050  with  an  average  effect 
of  $322). 1  Not  surprisingly,  comparisons  among  VICI,  HUD,  and  other 
YCCIP  participants  failed  to  identify  a  dominant  program.  All  of  the 
effects  of  VICI  participation  were  estimated  after  controlling  for 
demographic  characteristics,  geographical  location,  and  the  date  of  th 
participant's  most  recent  interview.  The  evaluation  report  states  tha 
personal  characteristics  did  not  exhibit  statistically  significant 
effects  on  outcomes,  while  site  differences  did,  but  these  results  are 
not  shown  in  the  report. 

The  evaluation  design  of  the  study  is  seriously  flawed  in  several 
respects.  The  nature  of  the  various  programs  used  to  make  comparisons 
with  VICI,  as  well  as  the  participants,  differed  from  VICI.  The  YCCIE 


xThe  analyses  of  outcomes  are  based  on  various  multivariate  tech¬ 
niques,  including  binomial  logit,  log-linear  regression,  and  tobit 
analysis.  The  interpretation  of  the  program  effects  therefore  varies. 
For  example,  the  finding  with  respect  to  employment  is  that  the 
likelihood  of  employment  is  111  percent  higher  among  VICI  participants 
than  among  "controls."  This  finding  implies  that  for  a  participant 
whose  probability  of  employment  was  0.5  prior  to  the  program  the 
probability  would  be  about  0.68  after  participating;  one  whose 
employment  probability  was  0.9  prior  to  participating  would  have  a 
probability  of  0.95  fof  being  employed  after  participating  in  the  VICI 
program. 


programs  often  served  10  or  fewer  youths,  and  the  HUD  and  VICI  programs 
usually  enrolled  more,  up  to  120  and  60,  respectively.  In  addition, 
both  the  supervisory  ratios  in  the  programs  and  the  nature  of  the  work 
differed  from  VICI.  VICI  programs  were  construction  oriented;  the  HUD 
and  YCCIP  programs  included  less  skilled  activities,  usually 
landscaping  and  neighborhood  cleanup  (in  YCCIP) .  VICI  participants 
were  older  and  less  likely  to  be  enrolled  in  school. 

Because  of  high  sample  attrition  (only  37  percent  of  the  VICI 
participants  and  35  percent  of  the  combined  comparison  groups  were 
interviewed  at  the  8-month  follow-up)  ,  the  data  actually  used  for 
assessing  program  effects  consisted  of  the  most  recent  interview  data 
for  each  participant  who  was  interviewed  at  least  once  after  program 
completion.  In  addition  to  the  lack  of  equivalence  in  geographical 
coverage,  the  follow-up  sample  for  VICI  participants  differed  not  only 
from  the  general  VICI  participant  population  but  also  from  the  HUD  and 
YCCIP  comparison  groups.  The  study  could  not  determine  what,  if  any, 
biases  would  be  present  as  a  result  of  differences  between  the 
follow-up  samples  and  the  total  client  populations. 

Given  the  severe  shortcomings  of  the  evaluation  design,  what,  if 
anything,  can  be  learned?  The  report  may  provide  reliable  insights  and 
documentation  regarding  implementation  and  program  delivery  issues. 

Some  attention  was  paid  in  the  report  to  the  optimal  degree  of  site 
adherence  to  a  standard  plan  and  latitude  for  across-site  variations  to 
accommodate  local  conditions.  The  report  clearly  identifies  the  fact 
that  referral  agencies  had  little  incentive  to  refer  potential  clients 
to  the  competing  VICI  project.  The  educational  link  is  shown  to  be 
weak:  educational  institutions  had  little  incentive  to  play  an 
important  role  in  the  project.  Moreover,  participants  lacked  the 
energy  and  motivation  to  pursue  adult  education  at  the  end  of  a  day  on 
a  construction  project.  The  involvement  of  union  journeymen  as  crew 
supervisors  turned  out  to  be  particularly  helpful  in  job  placements 
because  of  the  journeymen's  knowledge  of  the  informal  labor  market  and 
their  contacts;  their  referrals  and  recommendations  carried  more  weight 
than  comparable  activities  by  CETA  job  developers. 

Although  an  evaluation  of  the  long-term  program  effects  is  ruled 
out  by  the  small  sample  size  and  limited  follow-up  period,  the  study 
does  attempt  a  benefit-cost  analysis  of  the  program  from  a  societal 
point  of  view.  Under  a  variety  of  alternative  assumptions,  the  present 
value  of  the  benefits  consistently  exceeds  the  present  value  of  the 
costs.  However,  benefit-cost  calculations  are  only  as  credible  as  the 
underlying  estimated  program  effects,  and  the  evaluation  study  fails  to 
provide  reliable  evidence  on  the  effectiveness  of  the  VICI  program  in 
changing  the  employment  and  earnings  prospects  of  disadvantaged  young 
people . 


Supported  Work 

Supported  Work  was  a  national  demonstration  program  begun  in  1975. 
The  program  concentrated  on  four  target  groups:  women  who  had  been 
receiving  Aid  to  Families  with  Dependent  Children  (AFDC)  for  several 
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years?  ex-addicts;  ex-offenders;  and  young  (17-  to  20-year-old)  high 
school  dropouts.  Five  of  the  15  sites  enrolled  dropouts.  Dropouts 
participating  in  the  program  had  no  immediate  plans  for  further  educa¬ 
tion  and  were  without  immediate  employment  prospects?  many  had  a 
history  of  delinquency.  Supported  work  sought  to  inculcate  participar 
with  the  necessary  work  habits,  desire  for  employment  stability,  skii: 
etc.,  for  future  labor  market  success?  these  were  to  be  achieved  throi 
subsidized  work  experiences  that  would  be  gradually  more  demanding  ant 

approximate  regular  unsubsidized  employment. 

Three  aspects  distinguish  the  Supported  Work  program:  (1)  peer 
group  support;  (2)  graduated  stress?  and  (3)  close  supervision.  The 
peer  group  aspect  was  implemented  through  the  assignment  of  individual 
to  work  crews  consisting  mainly  of  program  participants,  and  this 
aspect  was  accomplished  in  a  more  or  less  consistent  fashion  across 
sites.  Graduated  stress  was  intended  to  expose  the  participant  to 
increasingly  higher  performance  standards  that  eventually  corresponde< 
to  those  typical  of  regular,  unsubsidized  jobs.  There  was  a  good  deal 
of  variation  across  sites  in  how  this  program  aspect  was  actually 
implemented.  Close  supervision  was  designed  to  facilitate  the  transff 
and  then  development  of  skills,  proper  work  habits,  and  proper 
attitudes.  Supervisors  could  be  either  program  staff  or  nonprogram 
supervisors  from  the  host  employer. 

All  five  Supported  Work  sites  that  had  youth  enrollees  participat< 
in  the  evaluation.  Applicants  were  randomly  assigned  to  experimental 
and  control  groups.  Those  in  the  experimental  group  could  participate 
in  the  program  for  a  maximum  period  of  12  to  18  months,  depending  on 
the  site.  Both  experimentals  and  controls  in  the  sample  were 
interviewed  at  baseline  and  then  at  9-month  intervals  that  continued 
for  up  to  36  months  for  some  sample  members.2  For  purposes  of  the 
evaluation  study,  the  enrollment  period  started  in  the  second  quarter 
of  1975  and  lasted  until  the  second  quarter  of  1977.  The  maximum 
length  of  the  postprogram  period  covered  by  interviews  was  determined 
by  when  an  individual  enrolled.  On  average,  youths  in  the  program  lei 
it  well  in  advance  of  the  maximum  period  allotted  for  participation; 
only  about  18  percent  of  the  enrollees  left  to  take  other  jobs  or  to 
enroll  in  an  educational  or  training  program  (Maynard,  1980:Table 
III. 2) . 

The  statistically  significant  positive  effects  of  Supported  Work  < 
employment  rates,  hours  of  work,  and  earnings  were  largely  confined  t< 
the  period  of  participation  in  the  program  (see  Table  7.3).  During  t 
first  3  months  following  enrollment,  program  participation  increased 
average  monthly  earnings  of  participants  by  $289  (389  percent) ,  avera 
hours  worked  by  112  hours  per  month  (459  percent)  ,  and  the  probabilit; 


2 A  special  resurvey  was  conducted  over  the  period  July  1980- January 
1981.  This  resurvey  provided  data  covering  a  period  of  38-67  months 
following  initial  enrollment.  The  results  of  the  study  did  not 
substantially  alter  the  conclusions  reached  in  the  original  study 
(Maynard  et  al.,  1982). 


TABLE  7.3  Selected  Supported  Work  Outcome  Differences  For  Young 
Dropouts 


Months 

After 

Enrollment 

Percentage 

Employed 

Hours  Worked 

Per  Month 

Average  Earnings 
Per  Month 

1-3 

68* 

112* 

$289* 

4-6 

43* 

76* 

200* 

7-9 

27* 

52* 

146* 

10-12 

19* 

29* 

92* 

13-15 

4.3 

5 

8 

16-18 

-3.4 

-1.8 

18 

19-21 

-0.2 

-2.7 

13 

21-24 

1.4 

2.3 

29 

25-27 

0.1 

-2.5 

-9 

28-30 

-5.3 

4.2 

-26 

31-33 

-4.9 

-6.2 

-33 

34-36 

-5.2 

-5.9 

-21 

37-39 

2.4 

0.3 

9 

40-42 

-4.1 

-8.7 

-31 

43-45 

-1.4 

-2.7 

-20 

46+ 

2.1 

4.3 

18 

NOTE:  Adjusted  participant  group  mean  minus  control  group  mean. 

*Statistically  significant  at  the  .05  level  or  below  in  a  two-tailed 
test. 

SOURCES:  Data  for  months  1-15  from  Maynard  (1980) ;  data  for  months  16 
and  beyond  from  Maynard  et  al.  (1982). 


of  employment  by  68  percentage  points  (336  percent)  relative  to 
controls.  By  10  to  12  months  following  enrollment,  these  positive 
effects  attenuated  dramatically:  program  participation  raised  average 
monthly  earnings  by  $92  (56  percent)  ,  average  hours  worked  per  month  by 
29  hours  (58  percent)  ,  and  the  probability  of  employment  by  19  per¬ 
centage  points  (52  percent)  .  Beyond  13  months  from  the  date  of  initial 
enrollment,  program  participation  had  no  overall  statistically 
significant  effects  on  labor  market  outcomes  as  compared  with  members 
of  the  control  group.  The  fact  that  experimental  had  longer  job 
tenure  than  controls  because  of  program  participation  had  no  impact  on 
postprogram  employment  rates,  hours  of  work,  or  wage  rates  (Table  7.3). 

Statistically  significant  program  gains  in  hours  of  work  during  the 
period  of  actual  participation  tended  to  be  larger  among  younger 
participants,  females,  whites,  the  more  educated,  those  who  left  school 
because  they  wanted  a  job,  those  living  with  their  parents,  those 


raised  by  both  parents,  and  those  with  greater  job  training  in  the  year 
prior  to  enrollment.  Supported  Work  had  no  long-term  impact  on  educa¬ 
tion  and  training  decisions  or  on  drug  use.  Similarly,  there  were 
minimal  long-term  program  effects  on  welfare  dependence  for  youths,  and 
criminal  activity  was  not  reduced  by  the  program. 

Results  of  the  benefit-cost  analysis  of  the  program  indicate  that 
from  the  societal  viewpoint  estimated  costs  exceeded  estimated  benefits 
by  $1,465  per  youth  participant.  While  net  costs  were  found  to  be  quit 
sensitive -to  the  method  of  estimating  the  value  of  output  and  project 
costs,  none  of  the  alternatives  reversed  the  benefit-cost  result.3 

Overall,  the  evaluation  study  appears  to  have  been  very  careful  in 
its  attention  to  conditioning  factors,  random  assignment,  and  the  use 
of  appropriate  statistical  techniques.  We  are  therefore  confident  in 
the  stated  finding  of  no  postprogram  effect  for  the  severely  dis¬ 
advantaged  youths  who  participated  in  Supported  Work. 


Supported  Work  Youth  Variation 

Starting  in  July  1979  four  Supported  Work  sites  were  selected  to 
participate  in  a  special  variation  of  the  program,  the  Supported  Work 
Youth  Variation  (Scharfman,  1981) .  The  special  variation  was  directed 
toward  17-  to  20-year-old  high  school  dropouts,  many  of  whom  had  a 
history  of  delinquency.  Their  experiences  in  the  conventional  Supporte 
Work  program  were  unfavorable  compared  with  the  outcomes  for  other 
targeted  groups  participating  in  the  program.  The  variation  sought  to 
incorporate  features  not  generally  provided  in  the  regular  program, 
e.g.,  counseling,  vocational  education,  skills  assessment,  and 
training;  to  extend  the  length  of  the  program  to  24  months;  and  to 
establish  a  tangible  link  to  long-term  labor  market  success  and  thereby 
improve  in-program  performance.  Unfortunately,  there  was  no  comparisor 
group  for  this  follow-up  study  and  therefore  we  did  not  find  the 
reported  results  meaningful. 


3 On  the  basis  of  a  special  verification  study  conducted  in  three 
sites  among  ex-addicts  and  ex-offenders  in  the  sample,  self-reported 
arrests  were  found  to  be  underreported  by  46  percent,  on  average,  by 
both  experimentals  and  controls.  The  study  notes  that  the  measured 
underreporting  among  those  subgroups  may  or  may  not  be  generalizable  tc 
the  youth  sample  (Maynard,  1980) .  Before  estimating  the  value  of 
reduced  criminal  activity,  a  factor  of  1.7  is  applied  to  the  control- 
experimental  arrest  differential  to  correct  for  underreporting  in  the 
benefit-cost  calculations .  As  noted  in  regard  to  the  Job  Corps 
evaluation  (see  Chapter  6)  ,  no  underreporting  factor  is  generally 
accepted  in  the  criminal  justice  literature. 


Public  Versus  Private  Sector  Jobs  Demonstration  Project 

The  Public  Versus  Private  Sector  Jobs  Demonstration  Project  focused 
Dn  differences  in  postprogram  employment  and  earnings  between  partici¬ 
pants  in  fully  subsidized  public  sector  jobs  and  those  in  fully  sub¬ 
sidized  private  sector  jobs.  The  target  population  was  16-  to 
21-year-old,  out-of-school  youths  eligible  to  participate  in  the  Youth 
Employment  and  Training  Program  (YETP)  portion  of  CETA.  Five  YETP 
sites  that  were  operating  from  January  1979  to  April  1980  were  selected 
Eor  the  demonstration  project.  Eligible  youths  who  had  completed 
preliminary  forms  were  matched  in  pairs  within  each  site  on  the  basis 
Df  age,  race,  sex,  and  their  scores  on  a  reading  test  and  then  randomly 
assigned  to  a  fully  subsidized  job  slot  in  either  the  public  or  private 
sector.  The  subsidized  jobs  paid  the  minimum  wage  and  the  100  percent 
subsidy  lasted  25  weeks.  A  total  of  2,100  participants  began  the 
program.  As  is  typical,  there  was  participant  heterogeneity  across  the 
Eive  sites. 

Information  provided  for  our  review  documents  the  degree  of  effort 
[required  at  each  site  to  develop  job  slots  with  public  and  private 
employers.  This  information  was  disaggregated  by  industry  for  private 
employers  and  by  functional  areas  for  public  sector  employers.  In 
general,  more  effort  was  required  to  place  youths  in  private  sector 
subsidized  jobs  than  in  public  sector  subsidized  employment. 

Forty-four  percent  (921)  of  the  participants  completed  25  weeks  in 
the  program.  Completion  rates  were  higher  among  females,  blacks,  and 
those  in  public  sector  jobs  (49  percent)  than  in  private  sector  jobs 
(38  percent) . 

Immediate  postprogram  information  was  gathered  at  the  end  of  the 
program  period  and  at  3  and  8  months  after  program  termination.  At  the 
3-month  follow-up  only  about  43  percent  of  the  original  sample  could  be 
Located  and  interviewed  (54  percent  of  completers  and  34  percent  of 
noncompleters) .  Among  completers  the  full-time  job  rate  was  50  percent 
for  public  sector  participants  compared  with  64  percent  for  private 
ector  participants.  On  the  other  hand  the  part-time  job  rate  was  16 
to  17  percent  for  both  public  sector  and  private  sector  participants. 
Public  sector  participants  exhibited  a  higher  rate  of  enrollment  in 
educational  or  training  classes  (26  percent)  than  private  sector 
participants  (18  percent) .  After  controlling  for  various  individual 
characteristics,  private  sector  participation  continued  to  be 
associated  with  higher  postprogram  employment  rates. 

Results  from  the  8-month  follow-up  are  derived  from  the  approxi¬ 
mately  35  percent  of  the  original  sample  who  were  located  and  inter¬ 
viewed  (42  percent  of  completers  and  29  percent  of  noncompleters)  . 
Although  multiple  regressions  are  not  available  for  this  period,  the 
results  continue  the  earlier  patterns  among  program  completers:  the 
full-time  job  rate  was  higher  among  private  sector  participants  (61 
percent)  than  among  public  sector  participants  (52  percent) ,  and  the 
part-time  job  rates  were  much  the  same  for  public  sector  (23  percent) 
and  private  sector  (25  percent)  participants.  By  the  time  of  the 
8-month  follow-up,  none  of  the  private  sector  participants  and  only  4 
ercent  of  the  public  sector  participants  was  in  an  educational  or 


training  program.  At  the  time  of  the  8-month  follow-up,  there  was 
virtually  no  difference  in  the  employment  rate  for  completers  (80 
percent)  and  noncompleters  (78  percent)  ,  though  the  high  attrition 
makes  even  this  statement  problematic. 

We  cannot  conclude  on  the  basis  of  the  evaluation  that  there  was 
any  difference  in  the  effects  of  subsidized  employment  in  the  public 
versus  the  private  sector.  Although  private  sector  participation  was 
consistently  associated  with  higher  rates  of  subsequent  employment, 
adjustments  for  nonprogram-related  characteristics  considerably 
narrowed  the  private  sector  advantage.  The  evaluation  of  this 
demonstration  project  offers  no  basis  on  which  to  decide  whether  the 
effort  required  to  secure  subsidized  jobs  in  the  private  sector  was 
worth  the  additional  cost.  Although  the  study  appeared  to  be  very 
promising  in  terms  of  both  the  nature  of  the  project  it  described  and 
its  research  design,  sample  attrition  severely  limits  the  reliability 
of  the  reported  findings.  We  are  not  confident,  therefore,  about 
drawing  conclusions  about  the  effectiveness  of  the  project  or  about  t 
issue  of  the  desirability  of  subsidizing  public  sector  compared  with 
private  sector  jobs. 


PROGRAMS  SERVING  IN-SCHOOL  YOUTHS 

Table  7.4  presents  the  characteristics  of  the  two  programs  servin 
in-school  youths.  Table  7.5  summarizes  the  research  design  and  resul 
of  the  evaluations  of  those  programs. 


Summer  Youth  Employment  Program 

The  objective  of  SYEP  was  to  provide  economically  disadvantaged 
youths  (14-  to  21-year-olds)  with  summer  work  experience  in  order  to 
"assist  these  youths  to  develop  their  maximum  occupational  potential 
and  to  obtain  employment  not  subsidized  under"  CETA  (P.L.  95-524,  Sec 
481(b)).  Program  emphasis  varied  across  sites.  Some  sites  offered 
vocational  training,  others  provided  job  counseling,  some  a  combinati 
of  both.  Time  and  resource  constraints  were  cited  as  the  reasons  for 
not  recording  the  precise  program  elements  to  which  each  participant 
was  exposed.  Consequently,  nothing  can  be  learned  about  what  sorts  o 
interventions  were  particularly  effective  or  ineffective  in  accomplis 
ing  program  objectives.  Sites  also  differed  in  terms  of  geographic 
characteristics,  i.e.,  urban,  suburban,  and  rural,  and  in  terms  of 
adherence  of  eligibility  criteria. 

The  evaluation  we  considered  is  of  the  SYEP  conducted  at  eight 
sites  chosen  by  the  Department  of  Labor  in  the  summer  of  1979.  It  is 
based  on  data  for  approximately  2,000  youths  who  were  ostensibly 
randomly  chosen  to  participate  or,  if  not  accepted  into  the  program  c 
grounds  other  than  eligibility,  to  be  in  the  comparison  group.  Apprc 
mately  250  youths  were  divided  between  the  participant  and  comparison 
groups  in  each  site.  The  treatment  and  comparison  groups  differed 
significantly  in  terms  of  some  personal  characteristics  both  across  a 
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to  all  survey  respondents  in  pilot  sites  where  program  operated,  whether  they  participated  or  not. 
to  total  response  rate,  not  necessarily  the  analysis  sample. 


within  sites:  participants  were  older,  less  likely  to  be  black,  and 
more  likely  to  have  previously  participated  in  CETA  programs  than 
comparison  group  members. 

A  specially  designed  time-use  study  of  subsamples  of  participants 
and  nonparticipants  indicated  that  participants'  employment  during  the 
program’ was  considerably  greater  than  that  of  nonparticipants  (100 
percent  compared  with  20  percent) .  Unfortunately,  sample  sizes  in  the 
time-use  study  were  quite  small  (68  participants  and  65  nonparticipants) 
nd,  therefore,  the  results  are  probably  not  very  reliable  (A.L.  Nellum 
and  Associates,  1980). 

Sample  data  were  collected  at  the  beginning  and  end  of  SYEP  and  at 
3  months  postprogram.  A  program  completion  survey  instrument  was 
administered  to  participants  at  the  end  of  the  program,  but  no  survey 
</as  administered  to  the  comparison  group  at  the  corresponding  point  of 
time.  The  3-month  follow-up  survey  was  administered  to  both  the 
treatment  and  comparison  groups.  The  postprogram  analysis  sample  was 
composed  of  approximately  800  participants  and  700  nonparticipants, 
vhich  indicates  that  sample  attrition  was  greater  among  nonparticipants, 
attrition  was  not  uniform  across  sites,  however.  The  New  York  site 
apparently  had  the  worst  experience — attrition  among  nonparticipants 
*/as  higher  than  70  percent.  Cluster  analysis  was  used  within  each  site 
:o  identify  comparable  subsets  of  exper imentals  and  controls.  This 
procedure  reduced  the  sample  size  by  one-third  to  about  600 
Individuals — 14  cluster  groups  emerged  from  the  analysis.  Because  of 
the  degree  of  subjective  data  transformation  present,  the  results  of 
:he  cluster  analysis  are  at  best  suggestive  and  at  worst  statistical 
artifacts. 

A  stepwise  regression  analysis  of  the  determinants  of  hours  spent 
Ln  the  program  indicated  that  older  youths,  those  with  previous  CETA 
experience,  those  with  higher  reading  scores,  and  those  with  less 
education  tended  to  spend  more  hours  in  the  program.  Race  and  sex  as 
*ell  as  Standard  Assessment  System  measures  had  no  significant  effects 
an  program  hours  per  participant. 

At  the  pretest  there  were  no  significant  differences  between  par- 
:icipants  and  controls  in  plans  to  return  to  school.  At  the  time  of 
'he  follow-up,  3  percent  more  of  the  participants  than  the  controls 
*ere  in  school.  Although  this  difference  turns  out  to  be  statistically 
significant,  it  is  of  negligible  magnitude.  The  overall  imputed 
favorable  effect  of  SYEP  on  school  attendance  varied  by  cluster.  SYEP 
appeared  to  be  particularly  successful  in  this  regard  for  nondisadvan- 
:aged  17-year-old  black  males,  and  particularly  unsuccessful  for  15-  to 
L6-year-old  disadvantaged  white  males. 

Although  the  general  emphasis  of  SYEP  was  to  encourage  continued 
enrollment  in  school  rather  than  to  prepare  participants  for  immediate 
entry  into  full-time  employment  upon  program  completion,  the  information 
available  did  permit  an  examination  of  the  immediate  labor  market 
effects  of  SYEP  participation.  Overall,  at  the  follow-up  there  was  no 
significant  difference  between  participants  and  controls  in  the  rate  of 
full-time  employment,  but  there  was  a  relatively  large  and  statistically 
significant  difference  in  part-time  employment  between  participants  (25 
percent)  and  controls  (19  percent) .  This  result  is  consistent  with 


SYEP's  goal  of  encouraging  youths  to  return  to  school.  The  data 
indicate  that  the  program  was  particularly  successful  in  raising  the 
part-time  employment  rate  of  severely  disadvantaged  16-year-old  black 
males  during  the  subsequent  school  year  and  particularly  unsuccessful 
in  bringing  about  part-time  employment  for  severely  disadvantaged 
15-year-old  females. 

Overall,  the  program  seemed  to  have  no  significant  effect  on  the 
likelihood  of  contact  with  the  criminal  justice  system.  Also,  there  i 
no  evidence  of  program  effects  on  attitudes  toward  such  contact.  The 
results  did  indicate  mutually  negative  attitudes  by  participants  and 
program  personnel  toward  each  other. 

It  is  not  legitimate  to  treat  the  evaluation  results  as  if  they 
were  produced  by  a  random  experimental/control  group  design.  The 
manner  in  which  participants  and  nonparticipants  were  chosen  varied 
across  sites.  Also,  the  evaluation  report  does  not  explain  why  the 
youths  who  were  eligible  for  SYEP,  who  constituted  the  comparison 
group,  were  not  accepted  for  participation  in  SYEP.  Although  the  stud 
suggests  program  participants  gained  in  employment  during  the  program 
and  in  part-time  employment  after  the  program,  the  evaluation  design 
does  not  allow  reliable  inferences  to  be  drawn  about  the  effectiveness 
of  the  SYEP. 

As  with  other  public  employment  and  training  programs  in  the  1970s 
the  question  of  displacement  received  some  attention  with  regard  to 
SYEP.  The  number  of  jobs  provided  in  a  public  employment  program  may 
not  be  the  net  number  of  jobs  created  as  a  result  of  the  program 
because  some  of  the  jobs  would  have  existed  even  if  there  had  been  no 
special  jobs  program  and  because  the  participants  who  have  jobs  may 
displace  others  who  would  have  had  the  jobs  had  the  program  not 
existed.  To  the  extent  that  displacement  occurs,  it  is  argued,  the 
usual  estimates  of  the  social  benefits  of  the  program  may  be 
overestimates. 

The  determination  of  whether  displacement  occurs  for  employment  an 
training  programs  and,  if  so,  to  what  degree  and  in  what  circumstances 
is  quite  complex  at  both  a  practical  and  a  theoretical  level.  It 
should  be  noted  that  while  theory  suggests  that  there  may  be  displace¬ 
ment  leading  to  overestimates  of  benefits  as  conventionally  measured, 
there  is  also  a  theoretical  possibility  of  replacement,  if  program 
participants  are  moved  from  a  labor  surplus  market  to  a  labor  shortage 
market,  in  which  case  conventional  methods  would  overestimate  costs 
and,  thereby,  underestimate  the  net  social  benefits  of  the  program 
[see,  for  example,  Johnson  (1979)  and  Kemper  (1980)  for  discussion  of 
this  issue] .  While  estimating  the  degree  of  displacement  is  par¬ 
ticularly  relevant  in  the  context  of  estimating  the  net  social  benefit 
and  costs  of  a  given  program,  society  may  still  ask  what  proportion  of 
program  output  is  over  and  above  what  would  have  existed  in  the  absenc 
of  the  program. 

We  reviewed  two  attempts  to  estimate  displacement  in  the  Summer 
Youth  Employment  Program;  one  (Zimmerman,  1980)  relied  on  data  col¬ 
lected  from  personal  interviews  with  program  operators,  and  one  (Crane 
and  Ellwood,  1984)  was  based  on  aggregate  data  relating  state-level 
employment  to  enrollment  in  SYEP  and  other  variables.  The  study  by 


Simmerman  is  based  to  a  considerable  degree  on  supervisors1  judgments 
about  what  projects  would  have  been  undertaken  in  the  absence  of  the 
program  in  the  eight  sites.  It  concludes  that  "in  30  percent  of  the 
sases  the  output  produced  by  SYEP  project  participants  would  have  been 
produced  at  the  same  scale  by  alternative  suppliers  in  the  absence  of 
bhe  project"  (Zimmerman,  1980:77). 

The  study  by  Crane  and  Ellwood  takes  an  entirely  different  approach, 
[■he  authors  used  unpublished  data  from  the  Current  Population  Survey 
for  the  12  largest  states  for  1972-1978,  for  the  months  of  April,  July, 
and  October,  in  order  to  measure  employment  by  race  and  age  group,  and 
jnpublished  program  data  for  SYEP  placements  by  race  and  age  for  the 
same  states  over  the  same  time  period.  The  analysis  relates  employment- 
to-population  rates  for  nonwhite  16-  to  19-year-olds  by  state  to  the 
lumber  of  SYEP  jobs  per  civilian  nonwhite  16-  to  19-year-olds  for  the 
state,  using  various  other  employment  and  school  measures  to  control 
Eor  what  employment  would  have  been  in  the  absence  of  SYEP. 

In  such  a  regression,  the  coefficient  of  the  SYEP  placement  variable 
provides  an  estimate  of  how  much  each  SYEP  placement  increased  the 
smployment  rate  for  nonwhites  aged  16-19  across  the  12  states  during 
that  time  period.  Theoretically,  if  the  SYEP  job  caused  total  displace- 
nent,  the  coefficient  of  the  SYEP  variable  would  be  approximately  zero; 
Lf  there  were  no  displacement  the  coefficient  would  be  close  to  1.  The 
authors  conclude  (Crane  and  Ellwood,  1984:23):  "Regardless  of  the 
specification,  estimated  supplementation  effects  of  SYEP  seemed  to  fall 
Detween  .5  an  .75.  Thus  our  best  estimates  is  that  for  each  SYEP  job 
provided  to  nonwhite  youths,  one-third  of  a  job  is  lost  in  the  private 
sector  for  this  group."  Despite  their  assertion,  only  one  of  the  four 
squations  yields  an  estimate  that  is  significantly  different  from  both 
1.0  and  zero. 

Because  of  reservations  we  have  about  the  precision  of  the  estimates 
and  their  statistical  significance,  we  are  not  inclined  to  accept  the 
estimates  of  displacement  derived  from  this  study.  Overall,  we  do  not 
Delieve  that  either  the  Zimmerman  or  Crane  and  Ellwood  study  provide 
reliable  estimates  of  the  magnitude  of  displacement  in  the  Summer  Youth 
Employment  Program. 


Youth  Incentive  Entitlement  Pilot  Projects 

The  Youth  Incentive  Entitlement  Pilot  Projects,  which  was  mandated 
ander  YEDPA ,  was  the  largest  YEDPA  demonstration  program.  It  cost 
approximately  $240  million — $224  million  for  stipends  and  local  program 
operations  and  $16  million  for  monitoring  and  research  (Diaz  et  al., 
1982:150) — and  lasted  2-1/2  years  (early  spring  1978-August  1980)  with 
an  additional  phase-out  period  of  a  year  (fall  1980-summer  1981) . 
Low-income  youths  aged  16-19  who  had  not  yet  graduated  from  high  school 
constituted  the  eligible  target  population  for  the  program.  The  key 
nnovation  of  the  program  was  that  all  eligible  youths  who  lived  in  the 
target  area  were  entitled  to  a  job  if  they  met  enrollment  conditions. 
Eligible  youths  were  guaranteed  minimum-wage  jobs,  part-time  during  the 
school  year  and  full-time  during  the  summer  months. 


To  continue  their  participation  in  the  program,  participants  were 
required  to  be  enrolled  in  school  or  in  an  approved  alternative 
educational  program  and  to  be  making  satisfactory  progress  toward  a 
high  school  diploma.  The  short-run  goals  of  the  program  were  to  reduc 
school  dropout  rates,  raise  high  school  graduation  rates,  provide  work 
experience,  and  provide  income  during  the  program  participation  phase. 
The  longer-term  goal  was  to  improve  life-cycle  labor  market  outcomes  a 
a  result  of  staying  in  school  and  receiving  work  experience  (Farkas  e\ 
al.,  1984). 

In  all  there  were  17  demonstration  projects  across  the  country,  ar 
more  than  70,000  youths  participated.  As  implemented,  the  program  hac 
four  major  characteristics: 

1.  the  average  15-  to  16-year-old  was  enrolled  in  the  program  foi 
15  months  (13.4  in  the  full  program  plus  1.6  in  the  transition  year)  ; 

2.  71  percent  of  the  work  experience  jobs  were  in  the  public 
sector; 

3.  beyond  provision  of  the  job  itself,  very  few  services  and 
little  training  was  provided:  two-thirds  of  the  youths  in  the  progran 
received  orientation,  one-fourth  were  tested,  and  one-half  received 
employment  counseling; 

4.  the  enrollment  requirement  was  enforced  but  the  school 
attendance  and  performance  requirements  were  generally  not  enforced. 

YIEPP  was  not  a  skills  training,  job  search,  or  behavior 
modification  program.  Thus,  any  effects  observed  are  due  to  the  work 
experience  and  school  enrollment  aspects  of  the  program,  in  effect, 
the  youths  were  provided  with  jobs  and  then  left  on  their  own  to 
benefit  or  not. 

The  entitlement  program  was  designed  to  saturate  an  area  with 
jobs.  Consequently,  the  presence  of  the  program  could  have  an  effect 
on  the  employment  of  eligible  youths  even  if  they  did  not  participate 
in  the  program  since  the  total  number  of  jobs  available  in  the  local 
area  would  have  increased.  To  account  for  this,  an  innovative  approac 
was  taken  in  designing  the  evaluation — use  of  matched  sites. 

Four  of  the  large-scale  sites  were  selected  as  pilot  sites  for 
evaluation  purposes.  Four  sites  that  did  not  have  the  entitlement 
program  were  selected  as  comparison  sites.  Cincinnati,  a  program  site 
was  matched  with  Louisville;  Baltimore  with  Cleveland;  rural  Mississij: 
counties  with  other  rural  Mississippi  counties;  and  Denver  with  Phoenj 
The  evaluation  technique  was  to  estimate  regressions  on  outcomes  (e.g. 
employment);  the  independent  variables  were  individual  characteristics 
(to  control  for  factors  not  accounted  for  by  the  match)  and  a  dummy 
variable  indicating  whether  the  person  was  in  a  program  site;  the 
coefficient  on  the  dummy  variable  is  the  program  effect.  Clearly,  in 
using  this  approach  the  quality  of  the  match  becomes  critical. 

The  evaluation  was  also  designed  to  include  all  eligible  youths , 
both  participants  and  nonparticipants,  in  the  pilot-site  study  group. 
This  evaluation  strategy  can  counter  the  selectivity  bias  that  plagues 
evaluations  based  on  nonrandom  selection  of  participants  and  controls 
because  those  choosing  not  to  participate  can  differ  in  significant 


ways  from  those  choosing  to  participate.  This  method  also  yields 
information  on  what  the  program  participation  rate  might  be  given  a 
permanent,  ongoing  program.  Stratified  random  samples  of  eligible 
youths  from  the  pilot  sites  and  youths  from  the  comparison  sites  who 
would  have  been  eligible  had  YIEPP  operated  in  their  areas  were 
selected  as  the  interview  sample  for  the  evaluation. 

Youths  who  were  aged  15-16  at  the  start  of  the  program  constituted 
the  study  group  for  the  final  report  so  the  steady  state  effects  of  a 
permanent  program  for  16-  to  19-year-olds  could  be  determined.  This 
group  was  also  selected  because  it  was  believed  that  older  youths  had 
already  made  career  decisions  prior  to  being  aware  of  the  program  and 
that  this  would  contaminate  pure  program  effects.  In  addition,  the 
program  participation  rates  of  older  youths  were  lower  than  those  for 
the  younger  group,  e.g.,  through  summer  1980  cumulative  participation 
rates  were  66  percent  among  15-  to  16-year  olds  and  46  percent  among 
17-  to  20-year  olds. 

The  sample  for  the  final  analysis  was  limited  to  blacks  aged  15-16 
at  the  time  of  program  enrollment  because  they  constituted  the  over¬ 
whelming  majority  of  participants  and  because  most  Hispanic  youths  in 
the  final  evaluation  sample  were  residents  of  Denver,  a  site  that  had 
had  substantial  implementation  problems.  In  addition,  white  youths  in 
the  sample  were  considered  too  small  in  number  and  too  heavily  concen¬ 
trated  in  the  Cincinnati/Louisville  pair  (where  a  school  busing  con¬ 
troversy  led  to  substantial  changes  in  white  school  attendance)  to 
provide  reliable  separate  estimates.  The  sample  of  black  youths  num¬ 
bered  about  1,400  (excluding  Denver/Phoenix)  ;  about  40  percent  were 
from  Baltimore/Cleveland  and  30  percent  each  from  Cincinnati/Louisville 
and  rural  Mississippi. 

Because  other  large  YEDPA  programs  were  operating  in  the  comparison 
sites,  the  test  was  not  one  of  the  entitlement  program  compared  with 
nothing.  While  the  evaluation  provides  no  way  of  judging  how  signifi¬ 
cant  a  factor  this  characteristic  is,  as  in  other  evaluations  it  would 
probably  lead  to  an  underestimate  of  program  effects  since  youths  in 
the  matched  comparison  sites  were  able  to  participate  in  other 
employment  and  training  programs. 

As  noted  above,  the  program  was  run  as  a  full-fledged  entitlement 
between  spring  1978  and  August  1980.  During  the  transition  period 
between  August  1980  and  August  1981,  the  program  operated  at  a  reduced 
level  with  a  limited  number  of  openings.  The  true  postprogram 
follow-up  period,  as  defined  for  purposes  of  the  evaluation,  was  the 
postoperation  period  during  the  fall  semester  of  1981. 

The  follow-up  period  is  troublesome  in  several  regards.  First,  it 
is  not  a  long  period  in  which  to  observe  postprogram  effects,  and  it 
raises  serious  concerns  about  the  extent  to  which  effects  that  are 
observed  may  persist  over  time.  Second,  the  final  interview  covered 
less  than  2  months  of  the  postprogram  (i.e.,  postoperation)  period  for 
62  percent  of  the  sample.  While  most  youths  eligible  for  the  program 
did  not  receive  entitlement  jobs  during  the  transition  period,  the 
analysis  design  depends  on  defining  the  postoperation  period  as  the 
postprogram  period,  since  in  theory  the  employment  of  eligible  youths 
might  be  affected  by  the  availability  of  an  entitlement  job.  The 


evaluation  design  does  not  permit  examination  of  changes  in  program 
effects  over  time  because  time  since  leaving  the  program  cannot  be  a 
variable  in  this  design. 

There  are  statistically  significant  in-program  and  postprogram 
effects  on  weekly  earnings,  largely  attributable  to  enhanced  employme 
rates,  but  also  due  in  a  modest  way  to  small  but  statistically  sig¬ 
nificant  increases  in  hours  worked  and  wage  rates  received  (in  the 
postprogram  period) .  In-program  earnings  effects  during  the  school 
year  were  estimated  to  range  between  46  and  161  percent  higher  than 
weekly  earnings  in  the  absence  of  the  program.  Comparable  earnings 
effects  during  the  summer  periods  vary  between  48  and  65  percent. 

During  operation,  the  entitlement  program  significantly  lowered 
unemployment  rates  and  raised  employment  and  labor  force  participatio 
rates  for  young  blacks  as  well  as  for  all  youths.  The  magnitude  of  t 
effect  was  sufficient  to  eliminate  substantially  the  employment  and 
unemployment  differentials  between  black  and  white  youths  eligible  fo 
the  program.  Thus,  employment- to-populat ion  rates  for  blacks  increas 
from  21.1  to  41.3  percent,  and  those  of  whites  increased  from  31.2  to 
37.4  percent  during  the  program  (Farkas  et  al.,  1982).  Unemployment 
rates  decreased  during  the  program,  from  72.1  to  51.7  percent  among 
black  eligibles  and  from  61.1  to  54.8  percent  among  white  eligibles. 

An  important  finding  of  the  YIEPP  evaluation  is  that  approximatel 
two-thirds  of  the  youths  eligible  for  the  program  did  participate  at 
some  time.  This  finding  means,  in  part,  that  youths  are  willing  to 
work  at  the  minimum  wage  but  that  in  the  absence  of  a  program  like 
YIEPP  employers  are  unwilling  to  hire  as  many  (at  the  minimum  wage)  w 
wish  to  work.  It  may  also  mean,  in  part,  that  in  the  absence  of  such 
program  in-school  youths  are  not  as  likely  to  be  in  the  labor  force. 
YIEPP  demonstrated  that  a  system  can  be  found  to  employ  significant 
numbers  of  disadvantaged  youths. 

YIEPP  jobs  were  largely  in  the  public  sector;  private  sector 
involvement  increased  over  time,  but  the  participation  rate  of  privat 
business  was  generally  low.  The  percentage  of  all  youth  job  hours 
spent  working  for  private  work  sponsors  increased  from  14  percent  in 
September  1978  to  23  percent  in  June  1980. 

Although  not  empirically  tested  under  entitlement,  the  effect  of 
varying  subsidy  rates  on  private  employers'  willingness  to  participat 
was  estimated  in  Baltimore  and  Detroit  using  employers'  responses  to 
hypothetical  questions:  "Would  you  be  willing  to  act  as  a  work  spons 
at  a  50  percent  subsidy,  a  75  percent  subsidy,  etc."?  No  comparison 
was  made  between  expressed  willingness  to  participate  and  actual 
behavior  (Ball  et  al.,  1981).  Only  5  percent  of  businesses  said  they 
would  participate  if  offered  a  50  percent  subsidy;  10  percent  said  ye 
with  a  75  percent  subsidy.  Even  at  a  100  percent  subsidy,  only  18 
percent  of  private  employers  surveyed  said  that  they  would 
participate.  While  the  elasticity  of  the  employer  participation  rate 
with  respect  to  changes  in  the  subsidy  rate  appears  high,  i.e., 
doubling  of  the  subsidy  rate  more  than  doubles  the  indicated 
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participation  rate,  this  was  not  a  true  experimental  test  of 
participation  since  there  were  no  observations  of  actual  behavior. 

The  overall  effects  of  YIEPP  on  secondary  school  enrollment  and 
graduation  were  generally  inconsequential.  Virtually  all  of  the 
estimated  schooling  effects  are  statistically  insignificant.  However, 
for  black  females  in  1981,  there  was  a  sizable,  statistically  signifi¬ 
cant  reduction  in  college  enrollment;  otherwise,  the  overall  college 
enrollment  effects  are  statistically  insignificant,  with  some  variation 
across  sites.  This  particular  program  effect  is  troubling  and  deserves 
further  scrutiny. 

In  the  postprogram  follow-up  semester,  program  earnings  effects 
were  estimated  to  be  39  percent  above  weekly  earnings  in  the  absence  of 
the  program.  These  figures  took  the  sites  as  the  unit  of  observation 
and  are  based  on  average  earnings  increases  for  all  youths  in  the  site 
regardless  of  participation.  If  one  assumes  that  the  observed  effects 
persist  for  a  year,  there  would  be  an  estimated  increase  of  $545  in 
annual  earnings  for  eligibles. 

During  the  postprogram  period  in  the  fall  of  1981,  labor  force 
participation  rates  of  the  full  youth  cohort  were  higher  than  those  of 
the  comparison  group,  but  unemployment  rates  were  not  significantly 
different.  Among  young  black  eligibles,  unemployment  and  labor  force 
participation  rates  were  not  significantly  different  from  those  of  the 
comparison  group. 

Because  of  the  scale  of  the  entitlement  effort  and  its  potential  as 
a  model  for  future  programs  serving  a  substantial  portion  of  the  youth 
population,  we  devoted  considerable  effort  to  our  review  of  this 
evaluation.  We  concluded  that  the  YIEPP  evaluation  was  a  sound  one  and 
that  meticulous  attention  was  paid  to  the  problems  inherent  in  the 
quasi-experimental  (matched  sites)  design  used  in  the  evaluation.  The 
drifting  apart  of  matched  pairs  of  pilot  and  comparison  sites  over 
time,  i.e.,  the  Baltimore/Cleveland  and  Cincinnati/Louisville  pairs, 
was  recognized.  The  potential  bias  induced  by  attrition  was  sys¬ 
tematically  investigated  through  a  special  attrition  sample  and  found 
not  to  change  the  essential  conclusions  of  the  study. 

Although  not  enough  information  is  available  to  determine  the 
long-term  effects  of  YIEPP,  the  finding  that  there  are  noteworthy 
positive  in-program  effects  on  the  employment  rates  of  black  and  white 
youths  is  convincing.  Correction  of  program  effects  for  individual 
characteristics  using  regression  analysis  does  not  change  the 
results.  Unfortunately,  it  is  not  possible  to  be  as  confident  about 
other  in-program  effects  or  about  effects  generally  for  Hispanic  or 
white  youths  because  problems  with  the  Denver/Phoenix  and 
Cincinnati/Louisville  pairs  severely  reduced  the  number  of  Hispanics 
and  whites  in  the  study. 

Related  to  the  discussion  of  the  magnitude  of  the  employment 
effects  of  the  entitlement  program  is  the  issue  of  displacement  or  net 
job  creation.  The  report  on  in-program  effects  (Farkas  et  al.,  1982) 


estimates  that  one  new  job  was  created  for  each  1 . 4  entitlement  jobs 
funded  in  the  public  sector  and  for  each  2.2  jobs  funded  in  the  privat 
sector.  The  report  also  indicates  that  these  assessments  may  be  con¬ 
servative  in  the  sense  that  they  only  measure  the  extent  of  displaceme 
among  program-eligible  youths  and  do  not  include  a  measure  of  displace 
ment  of  ineligible  people  (e.g.,  nondisadvantaged  or  out-of-school 
youths  or  adults)  who  might  otherwise  have  been  hired. 

If  these  estimates  are  accurate,  approximately  40  percent  of  the 
measured  employment  change  resulted  from  shifting  people  who  would  hav 
been  employed  in  the  absence  of  the  program.  Such  a  finding  would  hav 
important  implications  for  the  net  effects  of  the  program  in  terms  of 
job  creation,  as  well  as  obvious  cost  implications. 

We  discussed  earlier  the  complexities  involved  in  estimating  dis¬ 
placement  in  connection  with  our  review  of  the  Summer  Youth  Employment 
Program  above,  and  many  of  those  concerns  apply  here  as  well.  Because 
samples  of  youths  were  drawn  both  in  the  entitlement  pilot  sites  and  i 
the  matched  comparison  sites,  one  could  in  theory  capture  one  major 
element  of  the  degree  of  displacement  by  using  the  comparison  site 
figures  to  estimate  what  the  employment  of  entitlement-age  youths  woul 
have  been  had  there  been  no  entitlement  project. 

This  is  essentially  what  Farkas  et  al.  (1983)  did  by  comparing  the 
employment  rates  in  the  pilot  sites  with  those  in  the  comparison  sites 
during  the  period  of  program  operation  for  similar  age-race  groups  and 
then  dividing  the  differences  in  employment  by  the  number  of  entitleme 
jobs  in  the  pilot  sites  to  measure  net  job  creation  displacement.  The 
estimate  of  the  magnitude  of  net  job  creation  is  about  70  percent, 
implying  displacement  of  around  30  percent.  At  the  same  time,  control 
sites  probably  had  substantial  numbers  of  youths  in  YEDPA  and  other 
federal  employment  and  training  programs,  and  so  the  meaning  of  YIEPP 
displacement,  even  if  accurately  measured,  is  not  clear. 

Another  study  of  displacement  in  the  entitlement  program  (Gould  et 
al.,  1982)  surveyed  a  sample  of  private  firms,  both  those  that  had 
actually  provided  jobs  for  entitlement  participants  and  those  that  had 
not.  Information  was  gathered  on  the  levels  of  output  and  employment 
in  these  firms  before,  during,  and  after  the  period  of  the  entitlement 
program.  Using  the  data  from  the  period  before  entitlement  and  for 
those  firms  not  directly  hiring  participants,  the  authors  developed 
econometric  models  that  provided  estimates  of  what  employment  in  the 
firms  would  have  been  had  there  not  been  an  entitlement  project.  (The 
analysis  was  complicated  by  the  fact  that  even  in  the  preprogram  perio 
many  of  the  employers  had  other  subsidized  workers,  presumably  from 
CETA  programs,  in  their  firms.)  The  authors  estimate  that  about  40 
percent  of  the  jobs  created  through  entitlement  resulted  in  displace¬ 
ment. 

While  this  was  an  imaginative  and  interesting  effort,  several 
features  of  it  could  lead  one  to  question  the  precise  magnitude  of  the 
estimate  of  displacement.  First,  the  response  rate  to  the  initial 
survey  was  rather  low  (54  percent).  Second,  we  have  some  doubts  about 
the  ability  of  the  econometric  model  based  on  limited  preprogram  data 
to  estimate  what  employment  would  have  been  in  the  absence  of  the 
program  when  operating  with  a  small  sample  of  highly  individualized 
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firms  in  particular  localities.  Third,  and  perhaps  most  important, 
this  method  provides  no  indication  of  what  happened  to  those  workers 
and  resources  that  were  displaced  from  these  particular  firms.  Did 
they  find  alternative  employment  or  remain  unemployed?  Since  there  is 
no  market-wide  measure  of  the  degree  of  shortage,  this  important  element 
in  the  determination  of  the  final  degree  of  displacement  is  missing. 

We  believe  that  the  technical  problems  with  each  of  the  studies 
estimating  displacement  in  the  entitlement  program  are  sufficient  to 
prevent  confidence  in  accepting  any  given  point  estimate  of  its 
magnitude . 

There  remain  several  other  concerns  about  the  entitlement  evalua¬ 
tion's  findings.  The  in-program  and  postprogram  findings  vary  con¬ 
siderably  by  site.  As  noted  above,  we  are  convinced  that  the  positive 
in-program  effects  are  sound,  but  we  are  not  so  convinced  with  regard 
to  postprogram  effects.  The  postprogram  results  for  weekly  earnings 
show  a  negative  effect  for  Baltimore  (relative  to  Cleveland) ,  while 
Cincinnati  had  an  equal  absolute  value  positive  effect  (relative  to 
Louisville)  with  a  smaller  sample  size  than  Baltimore,  and  the  effect 
for  rural  Mississippi  was  positive.  Hence,  the  finding  of  an  overall 
positive  postprogram  effect  is  influenced  considerably  by  the  results 
for  Mississippi. 

In  other  words,  if  the  analysis  is  limited  to  urban  sites,  the 
average  effect  is  zero  or  slightly  negative.  The  researchers  explain 
the  negative  Baltimore  effect  by  noting  an  unexpectedly  healthy 
Cleveland  economy  that  might  diminish  the  quality  of  the  match  over 
time.  However,  Baltimore  was  described  as  the  best  run  of  the 
programs.  Because  of  across-site  disparities  in  results  and  because  it 
does  not  seem  plausible  to  average  rural  and  urban  sites,  the 
entitlement  program  results  are  most  appropriately  viewed  as  separate 
case  studies.  It  is  therefore  difficult  to  see  how  to  extract  results 
on  postprogram' effects  that  are  generalizable  to  the  nation  as  a  whole. 

The  estimated  postprogram  effects  of  the  entitlement  program  vary 
considerably  across  demographic  subgroups  as  well  as  sites.  The 
postprogram  earnings  effects  for  young  black  males  are  (nominally) 
twice  those  for  young  black  females,  $13.66  and  $6.13  respectively,  but 
the  estimates  for  females  are  not  significantly  different  from  zero. 

The  postprogram  effect  on  weekly  earnings  for  older  (17-  to  20-year-old) 
black  youths  was  $4.14,  and  the  effect  for  15-  to  16-year-old  whites 
and  Hispanics  was  one-sixth  the  size  of  the  effect  for  comparable 
blacks,  approximately  $1.53  per  week.  Both  effects  were  statistically 
significant. 4 


4  This  result  is  based  on  the  weighted  averages  of  estimated  weekly 
earnings  effects.  The  weekly  earnings  effect  of  $9.11  for  the  young 
black  cohort  (Denver/Phoenix  included)  declines  to  $7.45  for  the  full 
young  cohort,  i.e.,  when  Hispanic  and  white  youths  are  added  (Farkas  et 
al.,  1984).  Using  the  sample  weights,  we  computed  the  estimated 


Besides  weekly  earnings  effects,  other  outcomes  also  differed 
considerably  by  sex.  The  school  enrollment/graduation  outcomes  for 
females  did  not  appear  to  follow  any  pattern  .  Overall  the  program 
appears  to  have  reduced  college  enrollment  for  females  in  two  of  the 
three  sites.  There  is  no  readily  apparent  explanation  for  this  result 
since  high  school  graduation  rates  are  not  significantly  lower  in  thos 
sites.  Between  the  first  interview  and  the  last,  the  proportion  of 
young  black  females  with  one  or  more  children  increased  from  6  to  48 
percent  in  one  site  and  varied  substantially  across  the  sites.  The 
estimated  employment-related  effects  for  young  black  women  relative  t< 
men  are  probably  influenced  to  some  degree  by  the  high  rates  of 
childbearing  that  characterized  young  black  females  in  the  sample. 

SUMMARY 

The  evaluations  of  temporary  jobs  programs  consistently  found 
evidence  that  in-program  earnings  and  employment  were  higher  as  a 
result  of  the  program.  The  findings  of  the  Summer  Youth  Employment 
Program  evaluation  tentatively  suggested  in-program  gains  in  employ¬ 
ment,  but  we  have  only  limited  confidence  in  the  evaluation.  The 
Supported  Work  and  entitlement  evaluations  provided  the  strongest 
evidence  on  this  issue. 

In  the  case  of  Supported  Work,  a  program  serving  severely  dis¬ 
advantaged  dropout  youths,  monthly  in-program  earnings  of  participant! 
were  $289  above  those  earned  by  the  control  group  during  the  initial  i 
months  after  enrollment  in  the  program.  Youths  eligible  for  the 
entitlement  program  earned,  on  average,  up  to  $9  more  per  week  during 
the  School  year  than  the  comparison  group  and  up  to  $10  more  per  week 
during  the  summer.  Earnings  of  the  black  youth  cohort  were  as  much  a: 
$12-$13  higher  than  the  comparison  group's  during  both  the  school  yea: 
and  the  summer  months  (Farkas  et  al.,  1982). 

For  participants  in  Supported  Work,  97  percent  were  employed  durii 
the  first  3  months  after  enrollment,  compared  with  29  percent  of 
nonparticipants.  Employment  rates  of  young  blacks  in  the  entitlement 
program  were  up  to  26  percentage  points  (235  percent)  higher  during  tl 
program  than  those  of  youths  in  the  comparison  sites. 

From  this  evidence  we  can  generally  conclude  that  temporary  jobs 
programs  effectively  increased  employment  for  participants  and,  hence 
served  an  income  transfer  goal  that  has  been  an  underlying  rationale 
many  such  programs.  Without  regard  to  the  merits  of  this  particular 


where,  n^  equals  black  youth  cohort  weight,  n2  equals  white  and 
Hispanic  youth  cohort  weight,  and  X  equals  weekly  earnings  effect  for 
white  and  Hispanic  youths: 

$9.11  (.781)  +  X  (.219)  =  $7.45 
X  (.219)  =  $7.45  -  $7,115 
X  (.219)  =  $0,335 
X  *  $1.53 


urogram  goal,  the  extent  to  which  the  estimated  employment  effects  of  a 
jobs  program  translate  into  an  increase  in  the  total  number  of  jobs 
tvailable,  an  increase  in  the  number  of  employed  persons,  or  a  decrease 
.n  the  number  of  unemployed  persons  may  vary. 

While  there  is  considerable  disagreement  about  the  proper  way  to 
jstimate  displacement  in  job  creation  programs,  and  a  corresponding 
listrust  of  any  given  point  estimate  of  its  magnitude,  most  researchers 
md  policy  makers  acknowledge  the  displacement  problem.5  Prom 
society's  point  of  view  the  nature  of  displacement  may  be  as  important 
is  its  level.  Thus,  if  a  program  displaces  people  who  are  more 
idvantaged  than  participants,  and  who  could  easily  find  alternative 
:mployment,  it  may  be  considered  less  a  problem  than  if  the  program 
iisplaces  individuals  who  are  equally  disadvantaged  (Masters,  1981). 

The  estimated  in-program  effects  on  labor  market  outcomes  other 
:han  employment  rates  and  earnings  were  variable  among  the  programs  and 
lor  different  target  groups  within  most  of  the  programs.  The  entitle- 
lent  program  significantly  lowered  unemployment  rates  and  raised  labor 
iorce  participation  rates  for  all  eligibles  in  the  young  cohort.  Among 
Supported  Work  participants,  gains  in  hours  worked  tended  to  be  larger 
tmong  those  who  were  younger,  females,  white,  and  more  educated, 
leither  the  Public  Versus  Private  Sector  Jobs  Demonstration  Project  nor 
rICI  provided  much  information  on  in-program  effects. 

Because  the  research  design  of  the  entitlement  program  required  the 
tbility  to  measure  postprogram  effects  in  an  entire  youth  labor  market 
[not  only  for  participants)  ,  the  postprogram  period  was  defined  as  the 
:ime  following  the  close  of  the  program.  Thus,  the  postprogram  period 
lor  the  entitlement  program  was  the  fall  semester  of  1981,  and  62 
>ercent  of  the  black  youth  sample  was  interviewed  within  2  months  of 
:he  time  the  program  terminated. 

The  entitlement  program  increased  postprogram  earnings  of  eligible 
(lack  youths  by  the  equivalent  of  $545  per  year  (assuming  measured 
>ostprogram  gains  persisted)  and  raised  postprogram  hours  worked  for 
imployed  black  youths  by  6  percent  (from  32  to  34  hours  per  week) . 
imployment  rates  were  higher  among  blacks  and  labor  force  participation 
'as  higher  for  the  full  youth  cohort.  Neither  labor  force  participation 


For  example,  the  YEDPA  authorizing  legislation  and  the  1978  CETA 
imendments  required  the  Secretary  of  Labor  to  make  periodic  reports  on 
arious  aspects  of  the  entitlement  program,  including  displacement. 
Reports  were  to  include  findings  with  respect  to  enrollment;  costs;  the 
legree  to  which  out-of -school  youths  returned  to  school  or  others 
emained  in  school;  the  percentage  of  eligible  youths  participating; 

:he  kinds  of  jobs  provided  and  a  description  of  the  employers — public 
md  private;  the  degree  to  which  on-the-job  or  apprenticeship  training 
ras  offered;  the  estimated  cost  of  extending  the  program  to  all  areas; 
:he  effect  of  the  program  in  reducing  youth  unemployment  in  the  pilot 
treas;  and  the  effect  of  program  job  opportunities  on  other  oppor- 
:unities  for  youths  in  the  area  [P.L.  95-93  (YEDPA),  Sec.  329;  Report 


rates  nor  unemployment  rates  of  the  young  black  cohort  of  entitlement 
eligibles  were  significantly  different  from  those  of  the  comparison 
group  in  the  short  postprogram  period  (Parkas  et  al.,  1982). 

There  is  limited  evidence  on  the  long-term  effects  of  participatic 
in  temporary  jobs  programs.  The  Supported  Work  program  clearly 
indicated  no  such  effect  for  the  severely  disadvantaged  dropouts  it 
served.  The  evidence  from  the  other  studies  is  less  clear,  for  a 
variety  of  methodological  reasons.  Most  of  the  other  studies  analyzed 
a  maximum  of  8  months  of  postprogram  experience,  some  as  little  as  3 
months.  The  VICI  evaluation  was  designed  to  measure  effects  8  months 
after  program  participation,  but  was  generally  unconvincing. 

The  studies  of  temporary  jobs  programs  that  we  examined  were  not 
very  encouraging  about  the  goal  of  raising  school  attendance  rates, 
lowering  drug  abuse,  or  reducing  negative  encounters  with  the  criminal 
justice  system.  With  respect  to  school  retention,  the  summer  jobs 
program  evaluation  offered  questionable  evidence  in  support  of 
increased  school  participation.  The  entitlement  program  had  no  effect 
on  either  school  retention  of  youths  already  in  school  or  school 
completion  by  dropouts  who  had  returned. 


8 


Effectiveness  of 
Job  Placement  Programs 


The  final  type  of  program  reviewed  by  the  committee  attempted  to 
d  youths  directly  in  finding  employment.  The  programs  usually 
fered  some  services  in  addition  to  job  referral:  workshops  on 
eparing  resumes,  instruction  in  appropriate  behavior  during  a  job 
terview,  and  support  groups  for  job  seekers  supplemented  the  more 
aditional  job  referral  activities.  While  these  programs  offered  some 
rvices  that  overlapped  those  we  have  previously  termed  labor  market 
eparation,  they  are  distinguished  by  their  very  concrete  focus  on 
uring  employment,  within  a  specified  time  period,  for  the  youths  in 
e  program.  In  addition,  wage  subsidies  (sometimes  to  employers  and 
metimes  to  the  youths  themselves)  were  occasionally  used  as  a 
ansitional  device  to  get  youths  situated  in  suitable  jobs;  the  hope 
that  the  job  would  continue  after  the  subsidy  ended. 

Overall,  the  evaluation  reports  in  the  job  placement  category  were, 
th  one  exception,  generally  weaker  in  methodological  rigor  than  those 
dressing  other  program  goals.  As  a  consequence,  conclusions  about 
effectiveness  of  job  placement  efforts  are  at  best  tentative. 


PROGRAMS  FOR  OUT-OF-SCHOOL  YOUTHS 

Among  the  reports  that  passed  our  initial  screening  were  those  of 
ur  projects  that  represented  job  placement  efforts  serving  out-of- 
hool  youths:  70001,  Job  Factory ,  Job  Factory  Voucher  Program,  and 
b  Track.  Table  8.1  details  the  characteristics  of  each  of  these 
ograms;  Table  8.2  details  the  research  design  and  results  of  the 
aluations  of  the  programs. 


70001 

70001  was  a  job  search  program  for  out-of-school  youths  aged 
-21.  Enrollment  was  60  percent  female  and  87  percent  minority;  the 
rage  participant  was  18  years  old;  only  1  percent  held  high  school 
grees.  The  program  consisted  of  an  average  of  32  hours  of  treatment 
olving  job  preparation  workshops,  job  search  training,  and  the 
ke.  Similar  to  other  job  search  programs,  it  attempted  to  teach 
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youths  what  employers  expected,  to  teach  them  job  search  skills,  and 
motivate  them.  Unlike  some  other  programs,  the  evaluation  report 
indicates  that  the  staff  did  some  (unspecified)  amount  of  follow-up 
with  the  youths  after  they  had  found  a  job. 

The  research  design  by  the  Corporation  for  Public/Private  Venture 
(CPPV)  is  a  matched  comparison  of  youths  in  five  program  cities?  all 
the  evaluations  were  operated  by  the  central  organization.  The  sampl 
size  was  approximately  500  participants  (all  program  entrants  in  the 
five  cities  between  January  1979  and  April  1980)  and  400  comparisons 
drawn  from  a  variety  of  sources,  including  Employment  Service  registe 
school  dropout  lists,  and  other  sources.  The  report  notes  that  an 
earlier  evaluation  with  a  shorter  follow-up  period  found  significant 
initial  gains  followed  by  equally  large  decay  effects  for  a  similar  j 
search  program  (Jobs  For  Youth) ,  while  the  initial  gains  for  70001  di 
not  appear  to  decay.  An  important  question  was  whether  this  effect  w 
an  artifact  of  the  sampling  procedure  (program  termination  dates  are 
uncertain  and  the  follow-up  may  work  to  keep  youths  in  jobs)  or  wheth 
the  effects  persisted. 

The  placement  rate  was  50  percent,  and  the  cost  per  enrollee  (in 
1979)  was  $1,351.  The  initial  difference  in  earnings  between 
participants  and  comparisons  ($12  per  week  more  or  35  percent  higher) 
is  statistically  significant,  but  by  24  to  40  months  after  starting  t 
program  there  is  no  significant  difference  between  the  earnings  of 
participants  and  comparisons.  The  evidence  thus  suggests  that  the 
program  may  provide  a  brokering  or  screening  function  in  helping  yout 
to  obtain  job  placements  and  that  this  effect  decays  with  time  as 
nonparticipants'  earnings  eventually  reach  parity.  The  decay  effect 
persists  in  multiple  regression  analyses  controlling  for  various 
individual  characteristics  and  does  not  change  for  various  age,  sex, 
race  groups. 

With  respect  to  job  quality,  at  the  24-  to  40-month  follow-up,  25 
percent  of  the  male  participants  and  5  percent  of  the  female  partici¬ 
pants  held  skilled  jobs.  For  the  comparison  group,  the  figures  were 
percent  and  19  percent.  The  authors  attribute  the  female  pattern  to 
higher  rate  of  childbearing  by  the  participants,  but  even  when  the 
analysis  is  limited  to  women  with  no  children,  the  comparison  group 
does  as  well  as  the  participants. 

The  program  stressed  completion  of  the  General  Equivalency  Diploir 
(GED) ,  and  there  appears  to  be  a  significant  long-term  impact;  31 
percent  of  the  participants  received  a  GED  compared  with  12  percent  c 
the  comparison  group.  However,  only  3  percent  of  the  participants 
received  a  regular  high  school  degree  compared  with  9  percent  of  the 
comparison  group.  Hence,  the  comparative  results  for  educational 
attainment  are  slightly  lower  than  the  GED  results  imply,  but  still 
favor  the  participants  by  a  statistically  significant  amount.  There 
are  no  other  noticeable  effects  with  respect  to  training,  military 
service,  crime  reduction,  or  the  like.  H 

The  report  cautions  that  the  evaluation  sites  were  known  to  perfc 
better  in  terms  of  job  placement  than  sites  not  chosen.  Thus,  the 
sample  may  not  be  representative  of  all  70001  programs  operating  duri 
the  1979-1980  period.  The  response  rate  at  24-40  weeks  postprogram  w 


87  percent,  and  there  appears  to  be  no  substantial  attrition  bias 
(efforts  were  made  to  control  for  attrition  bias) . 

Participants  and  comparisons  appeared  to  be  matched  closely  in 
terms  of  most  demographic  characteristics  with  the  exception  that  at 
entry  female  participants  had  significantly  fewer  dependents  than 
comparison  group  females .  The  difference  was  no  longer  significant  at 
the  24-  to  40-month  follow-up,  apparently  because  of  higher  rates  of 
childbearing  among  participants .  Female  participants  were  also 
significantly  younger  than  nonparticipants . 

Overall,  we  believe  that  the  results  of  the  evaluation  of  the  70001 
sites  studied  are  reliable,  but  the  results  may  not  be  generalizable  to 
all  sites  because  the  sample  sites  were  known  to  be  better  than  average 
prior  to  selection. 


Job  Factory 

Brandeis  University  evaluated  job  search  assistance  programs  that 
operated  in  Cambridge,  Massachusetts,  and  Wilkes-Barre,  Pennsylvania, 
from  1979  to  1980.  However,  because  of  severe  implementation  diffi¬ 
culties  with  the  program  in  Wilkes-Barre,  we  disregarded  the  portion  of 
the  report  dealing  with  that  program.  The  Cambridge  program,  the  Job 
Factory,  enrolled  50  youths  in  each  of  five  cycles.  The  first  and  last 
cycles  were  for  graduating  high  school  seniors  and  began  the  first  week 
in  June  of  1979  and  1980,  respectively.  The  middle  cycles  were  for 
dropouts.  Youths  in  the  first  cycle  and  one  of  the  middle  ones  received 
stipends  of  $3.10  per  hour  while  the  others  did  not.  Each  cycle  lasted 
four  weeks  and  youths  received  an  average  of  83  hours  of  motivation, 
job  search  preparation,  and  role-playing. 

The  research  design  used  random  assignment.  The  sample  size  was 
approximately  203  participants  and  165  control  individuals.  Data  were 
collected  on  a  variety  of  outcomes  including  the  job  finding  rate,  job 
characteristics,  job-finding  methods  used,  and  results  of  various  tests 
in  YEDPA's  Standardized  Assessment  System  (SAS)  battery. 

Data  from  the  first  follow-up  interview  at  6  weeks  postprogram 
indicated  that,  overall,  participants  were  about  one-third  more  likely 
to  be  employed  than  controls  (64  percent  and  48  percent)  .  By  the  time 
of  the  final  follow-up,  at  36  weeks  postprogram,  the  job  finding  rates 
was  slightly  higher  for  the  controls  (82  percent  were  employed  compared 
with  79  percent  of  participants) . 

The  quality  of  the  first  postprogram  job  did  not  differ  a  great 
deal  between  the  two  groups.  A  somewhat  larger  proportion  of  partici¬ 
pants  were  employed  full  time  (67  percent  compared  with  53  percent)  . 
Differences  in  hourly  wages  appeared  to  favor  participants  slightly 
($3.50  compared  with  $3.40  per  hour)  .  Although  the  participants 9  jobs 
appear  to  be  slightly  better,  this  may  be  understood  by  the  slightly 
larger  percentage  of  participants  in  jobs  that  were  subsidized  by 
public  funds  (20  percent  and  16  percent)  .  Of  the  seven  psychometric 
scale  items  in  the  SAS  battery  only  three  were  statistically  sig¬ 
nificant  at  the  .05  level  and  none  was  correlated  with  outcomes. 


the  follow-up,  but  the  differences  were  not  great:  e.g.,  at  the  final 
follow-up,  job  holding  for  seniors  was  83.3  percent  for  participants 
and  84.2  percent  for  controls;  for  dropouts,  the  numbers  were  73.9 
percent  and  78.6  percent,  respectively. 

Various  cost  calculations  indicate  that  the  average  cost  per  par¬ 
ticipant  was  $989,  the  cost  per  employed  youths  was  $1,441,  and  the  ne 
short-run  cost  per  new  job  (i.e.,  jobs  that  would  not  have  otherwise 
been  found  within  the  first  6  weeks  postprogram)  was  $4,468. 

Attrition  in  the  analysis  sample  was  substantial.  Responses  to  th 
interview  at  6  weeks  postprogram  were  obtained  from  64  percent  of  the 
participants  and  52  percent  of  the  controls;  at  20  weeks  postprogram 
response  rates  were  41  percent  and  34  percent,  respectively;  by  36 
weeks  postprogram  the  response  rates  were  26  percent  and  20  percent, 
respectively,  with  a  total  of  53  observations  for  participants  and  33 
for  controls. 

Significance  tests  of  the  differences  in  the  mean  characteristics 
of  jobs  between  controls  and  participants  were  not  presented  in  the 
evaluation  report.  Given  the  small  sample  size,  it  is  unlikely  that 
the  reported  differences  are  statistically  significant  at  conventional 
levels,  and  we  therefore  cannot  be  very  confident  about  program  effect 
especially  after  6  weeks. 


Job  Factory  Voucher  Program 

The  Job  Factory  Voucher  Program  was  a  variation  of  the  Job  Factory 
model  in  which  youths  received  a  wage  subsidy  if  they  found  employment 
quickly.  The  supplement  was  $1.50  an  hour  for  the  first  2  weeks  of 
work  and  $1  an  hour  extra  for  weeks  3-12.  Youths  were  recruited  for 
each  of  six  4-week  cycles  of  the  program  between  November  1980  and 
December  1981  and  randomly  assigned  to  one  of  three  treatments:  Job 
Factory  plus  voucher,  voucher  only,  or  no  treatment.1 

The  results  show  a  peculiar  pattern  of  effects.  At  4  weeks  post¬ 
program  the  full-treatment  group  does  better  than  the  voucher-only 
group  and  the  control  (no-treatment)  group.  By  12  weeks  the 
full-treatment  and  voucher-only  groups  are  equal,  and  by  20  weeks  the 
voucher-only  group  does  better  than  the  full-treatment  group.  Fifty- 
eight  percent  of  the  full-treatment  group  worked  between  the  second  an 
third  follow-up  compared  with  70  percent  of  the  voucher-only  group  and 
51  percent  of  the  control  group. 


1 A  Wilkes-Barre  program  that  provided  subsidies  to  employers  was  also 
evaluated,  ( River a-Casale  et  al.,  1982)  but  because  it  experienced 
severe  implementation  problems  and  did  not  use  a  comparison  group  of 
youths  not  participating  in  the  program,  the  committee  decided  that  th 
results  did  not  provide  reliable  evidence. 


Attrition  and  resulting  small  sample  sizes  may  account  for  some  of 
ie  findings.  Between  the  initial  data  collection  and  20  weeks  after 
rollment,  attrition  among  participants  in  the  full-treatment  group 
is  20  percent,  among  the  voucher-only  group  it  was  82  percent,  and 
long  the  control  group  it  was  38  percent.  Final  analyses  are  based  on 
>servations  for  60  controls,  23  participants  in  the  voucher-only 
oup,  and  128  in  the  full-treatment  group. 

A  number  of  other  methodological  problems  in  the  evaluation  are 
Luse  for  concern;  administrative  implementation  difficulties, 
tanging  characteristics  of  the  youths  over  the  course  of  the  program, 
id  interaction  among  youths  in  the  different  treatment  groups. 
>nsequently,  we  are  not  confident  in  the  results  of  the  Job  Factory 
>ucher  Program  evaluation. 


Job  Track 

Job  Track  was  a  job  search  assistance  program  that  offered  2  days 
:  job  search  training  followed  by  3  days  of  support  services  to 
it-of-school  youths  who  applied  to  local  Employment  Service  offices, 
irticipants  were  16-  to  21-year-old,  out-of-school  youths.  The 
ogram  operated  from  July  to  December  1980  in  San  Francisco.  Olympus 
jsearch  Centers  was  responsible  for  both  operating  the  program  and 
»ing  the  evaluation. 

Participant  outcomes  were  compared  with  those  of  a  matched  compari- 
>n  group  of  nonparticipants.  The  evaluation  sample  was  originally 
imposed  of  136  comparison  group  members  and  103  participants,  but  the 
lalyses  were  actually  based  on  88  participants  and  76  comparison  group 
>uths  at  the  6-week  follow-up  and  80  participants  and  69  comparison 
oup  youths  at  the  12-week  follow-up.  The  regression-adjusted  results 
:  6  weeks  postprogram  suggest  that  participants  were  more  likely  than 
inparticipants  to  be  employed  (46  percent  compared  with  28  percent) . 

:  the  12-week  postprogram  follow-up,  the  employment  rates  of  the  two 
oups  were  66  percent  and  49  percent,  but  the  difference  was  not 
:atistically  significant.  There  were  no  apparent  differences  in  job 
larch  intensity  or  the  number  of  methods  used.  About  50  percent  of 
le  youths  in  the  program  found  employment  without  going  through  a 
rmal  interview  procedure. 

Comparison  group  members  differed  from  participants  in  two  major 
aspects  that  would  suggest  that  comparisons  were  more  employable;  30 
;rcent  of  comparison  group  members  compared  with  18  percent  of 
irticipants  were  independent  (that  is,  neither  family  heads  nor  family 
smbers) ,  and  22  percent  of  comparison  group  members  and  13  percent  of 
irticipants  had  some  college  training.  We  have  limited  confidence  in 
le  findings  of  the  effects  of  the  original  Job  Track  program. 

A  modified  program.  Job  Track  II,  operated  for  10  weeks  between 
irch  and  June  1982.  The  new  program  offered  a  stipend  of  $50,  extended 
le  program  to  2  weeks,  and  differed  from  the  earlier  version  in  several 
;her  respects.  The  Job  Track  II  evaluation  did  not  use  a  comparison 
:oup,  but  compared  the  outcomes  of  participants  in  the  new  program 
Lth  those  in  the  earlier  one.  Therefore,  we  did  not  consider  the 
Lndings  of  the  Job  Track  II  program. 


PROGRAMS  FOR  IN-SCHOOL  YOUTHS 


The  committee  reviewed  reports  on  three  programs  that  provided  jol 
placement  services  for  in-school  youths?  Jobs  for  Delaware  Graduates 
jobs  for  America's  Graduates,  and  Project  Best.  Table  8.3  details  th< 
characteristics  of  each  of  these  programs;  Table  8.4  details  the 
research  design  and  results  of  the  evaluations  of  the  programs. 


Jobs  for  Delaware  Graduates 

Jobs  for  Delaware  Graduates  is  a  school-to-work  transition  prograi 
for  high  school  seniors.  Begun  in  Delaware,  it  is  currently  being 
replicated  throughout  the  country  by  a  central  organization,  Jobs  for 
America's  Graduates.  We  reviewed  two  evaluations?  one  of  the  origin; 
Delaware  program  done  by  Temple  University  (discussed  in  this  section 
and  one  based  on  four  sites  done  by  Northeastern  University  (discusse< 
in  the  next  section) . 

In  the  Jobs  for  Delaware  Graduates  (and  jobs  for  America's 
Graduates)  program,  high  schools  first  develop  lists  of  seniors  who  a] 
in  the  bottom  of  their  class  and  who  are  eligible  for  the  program.  Tl 
seniors  participate  in  as  many  as  three  rounds  of  interviews  and  then 
are  selected  to  enter  the  program  (34  percent  of  those  interviewed  we 
selected  in  the  programs  that  Temple  University  examined) .  The  progr< 
consists  of  job  preparation  workshops  (e.g.,  resume  writing  and 
interview  techniques) ,  a  support  club,  assistance  in  job  finding,  and 
follow-up  after  job  finding  by  program  counselors. 

The  Temple  evaluation  for  1980  Delaware  graduates  used  comparison 
groups  drawn  from  other  Delaware  high  schools  that  were  considered 
comparable  but  did  not  have  the  program.  By  1981  too  many  high  school 
in  Delaware  had  the  program,  so  for  the  evaluation  of  that  year  Tempi' 
examined  the  estimated  changes  in  program  effects  from  1  year  to  the 
next.  This  latter  evaluation  was  of  limited  usefulness  both  because 
further  changes  may  have  occurred  and  because  this  methodology  cannot 
eliminate  effects  of  changes  in  the  economy  between  the  two  periods. 
Hence  our  analysis  focused  only  on  the  study  of  1980  graduates. 

The  researchers  conducted  follow-up  interviews  3  and  8  months  afb 
graduation,  but  the  program  was  still  in  effect  even  after  8  months 
because  the  counselors  maintained  some  follow-up  contact.  Also,  give: 
the  findings  from  other  projects  concerning  decay,  8  months  may  not  b 
a  long  enough  follow-up  period  to  assess  postprogram  effects. 

The  differences  in  outcomes  between  participants  and  comparison 
group  members  at  the  time  of  the  3-month  interview  are  all  significan 
at  the  1  percent  level  or  better.  The  results  indicate  that  partici¬ 
pants  were  more  likely  to  be  employed  full  time  at  the  time  of  the 
interview  (56  percent  compared  with  36  percent) ,  more  likely  to  have 
held  a  full-time  job  (75  percent  compared  with  49  percent)  ,  and  more 
likely  to  have  been  employed  since  graduation,  (84  percent  compared 
with  73  percent) .  The  results  at  8  months  postprogram  indicate  that 
participants  still  fared  significantly  better  than  nonparticipants  in 
terms  of  employment,  though  the  difference  was  smaller  than  at  3  mont 
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rostprogram  (e.g.,  58  percent  of  participants  and  48  percent  of  nonpar- 
:icipants  were  employed  full  time  at  the  8-month  interview)  .2 

The  jobs  held  by  participants  and  nonparticipants  were  similar  in 
:erms  of  hours  per  week,  skill  level,  and  tenure.  However,  at  3  months 
jostprogram  participant  wages  on  the  most  recent  job  were  insignifi- 
:antly  below  those  of  the  comparison  group,  but  at  8  months  the 
articipants  had  an  edge  of  38  cents  an  hour  (participants  received 
>3.90  an  hour  in  the  late  fall  of  1980)  ,  and  this  was  statistically 
significant  at  the  10  percent  level.  Unfortunately,  this  is  the  only 
.nstance  of  a  statistically  significant  difference  in  the  nature  of 
jobs  held  and  hence  should  be  viewed  cautiously. 

There  were  no  differences  between  the  two  groups  in  terms  of  the 
iducational  Testing  Service's  (ETS)  measures  of  job  knowledge,  work 
ittitudes,  or  self-esteem.  There  was  a  significant  difference  in  a 
measure  of  job-seeking  skills  at  8  months  postprogram  that  favored 
>articipants .  The  job-holding  gains  of  the  participants  were  offset  by 
:he  nominally  higher  but  statistically  insignificant  postgraduation 
ichool  attendance  rates  of  the  comparison  group. 

Participants  in  the  Jobs  for  Delaware  Graduates  programs  differed 
.n  important  respects  from  those  in  other  programs  whose  evaluations  we 
reviewed.  All  were  high  school  seniors,  so  no  dropouts  were  included, 
md  potential  dropouts  may  have  been  screened  out.  Only  20  to  25 
>ercent  of  participants  were  economically  disadvantaged.  The  program 
.nvolved  an  extensive  preselection  process  that  may  lead  to  creaming, 
,.e.,  selection  of  those  applicants  who  might  be  easiest  to  place.  At 
:he  same  time,  the  youths  in  these  programs  were  not  in  college  prepara- 
:ory  or  vocational  programs  and  were  at  the  bottom  of  the  class  ranking 
Ln  the  general  curriculum. 

The  sample  of  participants  was  25  percent  economically  disadvan- 
:aged,  37  percent  minority,  and  56  percent  female;  25  percent  had  pre¬ 
viously  had  a  skilled  or  semiskilled  job,  and  72  percent  had  previously 
worked  in  a  job  paying  at  least  $3.17  an  hour.  Participants'  scores 
:or  the  SAS  reading  test  indicated  a  reading  level  of  eighth  grade  or 
ligher .  The  comparison  group  had  a  higher  percentage  of  minority 
vouths  (47)  and  a  higher  percentage  of  limited  English  speakers  (6.3 
compared  with  2.6)  ,  both  of  which  might  bias  the  results  in  favor  of 
:he  program,  but  the  comparison  group  had  a  better  work  history  (81 
aercent  had  previously  worked  and  48  percent  had  held  skilled  or 
semi-skilled  jobs) . 

While  the  results  were  less  favorable  at  8  months  than  at  3  months, 
ittrition  may  play  an  important  role.  Attrition  among  participants  was 
24  percent  3  months  after  graduation  and  28  percent  8  months  after 
graduation;  among  comparison  group  youths  attrition  was  31  percent  at  3 


JThe  summary  of  the  published  report  (Eleey  and  Leone,  1982)  states 
that  some  key  findings  are  insignificant  while  the  body  of  the  text 
states  that  they  are  significant  (Eleey  and  Leone,  1982);  these  incon¬ 
sistencies  were  corrected  in  an  errata  sheet  from  the  authors  that  says 
the  findings  are  statistically  significant. 


months  and  33  percent  at  8  months  after  graduation.  There  is  no  indie 
tion  that  attempts  were  made  to  adjust  for  possible  attrition  bias. 
Thus,  differences  in  attrition  rates  may  contribute  to  the  measured 
differences  in  postgraduation  experiences  between  participants  and 
nonparticipants.  Another  potentially  troubling  issue  on  which  the 
report  is  silent  is  the  treatment  of  dropouts.  Since  the  participant 
sample  includes  only  graduates,  the  appropriate  comparison  would  be 
nonparticipant  graduates.  Inclusion  of  nongraduates  in  the  comparisor 
sample  would  probably  tend  to  overstate  program  effects  on  employment. 

The  report  presents  what  we  found  to  be  convincing  evidence  of 
short-term,  i.e.,  3-month,  postprogram  effects  in  increasing  employmer 
The  8-month  findings  indicate  a  smaller  effect  and  are  less  convincing 
Because  of  sample  attrition  it  is  possible  that  what  appears  as  a  decs 
effect  is  due  at  least  in  part  to  attrition. 


Jobs  for  America's  Graduates 

The  Northeastern  University  study  of  Jobs  for  America's  Graduates 
was  sponsored  by  Jobs  for  America's  Graduates  and  was  a  6-month 
follow-up  of  spring  1982  graduates  in  four  states:  Arizona,  Massachu¬ 
setts,  Missouri,  and  Tennessee.  The  study  used  a  matched  comparison 
group  methodology  with  a  sample  of  1,106  participants  and  410  compari¬ 
sons.  The  total  sample  was  53  percent  female,  average  family  income 
was  $11,000,  and  95  percent  of  the  sample  were  high  school  graduates. 
Data  on  participants  were  collected  by  program  counselors  during  the  S 
months  of  postgraduation  follow-up  visits. 

The  results  indicate  that  during  fall  1982  participants  fared  sig¬ 
nificantly  better  than  nonparticipants  with  respect  to  the  probability 
of  being  employed,  weeks  employed,  hourly  wage  rates,  and  weekly  earn¬ 
ings.  No  analysis  of  intersite  differences  is  provided,  but  based  on 
other  studies  there  is  reason  to  believe  that  there  would  be 
substantial  variation  across  sites. 

Several  considerations  make  us  skeptical  of  accepting  the  results 
of  the  evaluation  of  Jobs  for  America's  Graduates.  First,  the  attriti 
rate  at  the  6-month  follow-up  was  6  percent  for  participants  but  40 
percent  for  the  comparison  group;  no  adjustments  were  made  for  possib] 
attrition  bias,  and  no  data  are  presented  that  allow  examination  of  th 
effect  of  attrition  on  the  match  between  participants  and  nonpartici¬ 
pants.  Even  if  the  results  reported  were  robust,  studies  of  similar 
programs  indicate  that  a  6-month  follow-up  period  is  too  short  to  allc 
valid  inferences  to  be  drawn  about  long-term  program  effects,  which  ai 
susceptible  to  decay.  Finally,  the  extensive  preselection  procedures 
used  may  have  produced  a  participant  group  that  is  not  generally 
representative  of  non-college-bound  high  school  seniors. 


Project  BEST 

The  Better  Employment  through  Skills  Training  Project  (Project 
BEST)  involved  1  hour  per  day  of  labor-market  oriented  classroom 


lining  in  conjunction  with  counseling  and  "job  shadowing"  for  disad- 
itaged  minority  high  school  seniors  in  an  inner-city  Philadelphia 
fh  school.  The  Temple  University  study  of  the  project  is  of  interest 
:ause  it  did  not  find  employment  gains  for  participants  relative  to 
i  comparison  group  at  3  and  11  months  postprogram. 

The  program  operated  during  the  1979-1980  and  1980-1981  academic 
irs  and  served  about  350  students.  While  the  study  suggests  that  the 
ject's  job  placement  strategy  was  ineffective,  its  findings  cannot 
taken  as  conclusive,  inasmuch  as  the  comparison  group  was  not  ran- 
ily  selected  (they  were  students  at  other  Philadelphia  high  schools) 

I  program  participants  were  self-selected.  While  the  evaluators 
:nowledged  the  selectivity  bias  inherent  in  this  approach,  they  made 
explicit  correction  for  it. 


SUMMARY 

While  most  of  the  evaluations  of  programs  offering  job  placement 
:vices  to  youths  found  the  programs  to  be  effective  in  securing 
>loyment  for  participants,  most  of  the  evaluations  had  serious 
zhodological  flaws  and  therefore  do  not  provide  reliable  evidence  on 
;  question  of  effectiveness.  Consequently,  we  do  not  believe  one  can 
iw  strong  inferences  about  program  effects  on  the  basis  of  these 
idies. 

Of  all  the  evaluations  of  YEDPA  job  placement  programs  serving 
:-of-school  youths,  the  CPPV  study  of  70001  comes  closest  to  providing 
istworthy  evidence  of  program  effectiveness.  The  program  reported  a 
percent  success  rate  in  placing  participants  in  jobs,  and  program 
sts  averaged  $1,351  per  enrollee.  For  the  demographic  characteristics 
>orted  in  the  evaluation,  there  is  a  reasonably  close  match  between 
j  comparison  and  the  participant  groups.  The  only  major  difference 
:ween  groups  was  that  female  participants  in  the  70001  program  had 
/er  dependents  than  the  comparison  group. 

Even  for  this  study,  however,  we  have  questions.  Besides  the  con- 
ms  generated  by  the  use  of  a  constructed  comparison  (rather  than  a 
idomly  assigned  control  group) ,  the  selection  of  sites  in  the  70001 
iluation  is  a  cause  for  concern.  The  chosen  sites  were  known  to  be 
:ter  performers  in  terms  of  job  placement.  The  resultant  evaluation 
:a  may  thus  provide  an  upper-bound  estimate  of  what  the  70001  programs 
lieved. 

While  the  design  of  the  70001  evaluation  is  somewhat  problematic, 
j  execution  and  reporting  of  the  research  were  rigorous  (see  CPPV, 

33)  .  In  contrast  to  most  of  the  studies  we  reviewed,  the  CPPV 
iluators  and  their  subcontractor.  Institute  for  Survey  Research, 
ople  University,  obtained  an  86  percent  response  rate  at  24+  months 
jtprogram.  Moreover,  the  report  is  appropriately  candid  about  the 
sign  problems  of  the  study,  and  it  presents  detailed  calculations  and 
scussions  of  the  potential  effects  of  selection  and  attrition  bias. 

Nine  months  after  completion  of  70001,  participating  youths  earned 
average  of  $12  per  week  more  than  the  comparison  group.  This 
Eference  in  earnings  arose  from  increased  employment  rather  than 


differences  in  wage  rates:  41  percent  of  70001  youths  and  29  percent 
of  the  comparison  group  were  employed.  A  subsequent  follow-up 
conducted  24-40  months  after  participation  in  70001  found  that  this 
program  effect  had  decayed  entirely:  employment  rates  were  38  percen 
for  70001  participants  and  42  percent  for  the  comparison  group. 

On  the  basis  of  the  70001  study  and  other  evaluations,  there  is 
evidence  that  the  effects  of  job  placement  programs  decay  over  time, 
that  after  24  months  there  is  no  discernible  difference  between 
participants  and  nonparticipants  on  most  outcomes. 

Two  highly  regarded  programs  for  in-school  youths.  Jobs  for  Delaw 
Graduates  and  Jobs  for  America's  Graduates,  served  a  segment  of  the 
youth  population  that  was  least  in  need  of  assistance  in  locating 
suitable  employment — high  school  graduates,  75  percent  of  whom  came 
from  families  that  were  not  economically  disadvantaged.  While  we  fou 
the  evidence  of  short-term  program  effects  convincing,  any  inference 
that  results  from  such  a  program  could  be  realized  with  economically 
disadvantaged  populations  or  with  school  dropouts  is  highly  speculati 


Evidence  of  Program  Effectiveness 
from  National  Data  Bases 


In  addition  to  the  program-specific  evaluations  of  YEDPA  effective¬ 
ness  that  were  reviewed  in  Chapters  5  through  8,  there  are  several 
evaluations  that  attempted  to  use  large,  representative  national 
samples  to  derive  estimates  of  the  impact  of  all  federally  funded 
employment  and  training  programs.  The  most  prominently  used  data  bases 
in  these  studies  were  the  Continuous  Longitudinal  Manpower  Survey 
(CLMS)  and  a  special  youth  sample  of  the  National  Longitudinal  Survey 
(NLS) .  Both  of  these  data  bases  involve  relatively  large  samples — more 
than  60,000  in  the  CLMS  and  more  than  12,000  in  the  NLS — that  are  drawn 
in  a  manner  designed  to  permit  generalizations,  for  CLMS,  to  the  uni¬ 
verse  of  participants  in  CETA  programs,  and,  for  NLS,  to  all  American 
youths.  There  was  also  a  YEDPA  attempt  to  collect  data  on  the  progress 
of  its  participants  and  activities.  While  the  major  charge  of  our 
committee  was  to  focus  on  the  YEDPA  knowledge  development  activities, 
we  also  reviewed  the  findings  from  studies  using  these  other  data 
bases,  and  we  evaluated  the  quality  of  YEDPA 's  Standardized  Assessment 
System. 

The  results  of  our  review  of  this  research  are  presented  in  detail 
in  Appendices  A  and  D.  In  this  chapter  we  summarize  our  conclusions 
regarding  this  evidence. 


THE  CLMS  AND  NLS  DATA  BASES 

The  studies  based  on  the  CLMS  and  the  NLS  use  data  gathered  in  a 
different  manner  and  have  a  somewhat  different  (and  wider)  focus  than 
the  program-specific  evaluations,  and  so  provide  an  important  supple¬ 
mentary  perspective  on  the  substance  and  problems  of  the  individual 
YEDPA  evaluations  we  reviewed.  Moreover,  these  studies  use  data 
derived  from  samples  with  high  sample-coverage  rates  and  low  sample 
attrition,  and  consequently  they  can  provide  a  more  adequate  evidentiary 
basis  (at  least  in  respect  to  sampling  mechanics)  than  many  of  the 
individual  program  studies  we  reviewed. 

Both  the  CLMS  and  the  NLS  are  full  probability  samples  whose 
sampling  designs  appear  to  have  been  well  executed.  Sample  coverage 
appears  high,  and  the  available  documentation  shows  considerable 
attention  to  important  methodological  details,  such  as  adequacy  of 


sampling  frame,  careful  screening  of  respondents  to  ensure  that  they 
are  within  the  universe  being  sampled,  extensive  follow-up  to  ensure  a 
high  response  rate,  and  so  forth. 

For  both  the  NLS  and  CLMS,  comparison  groups  must  be  constructed. 
The  basic  goal  in  selecting  a  comparison  group  is  to  find  a  sample  of 
individuals  who  closely  resemble  the  participants  in  employment  and 
training  programs.  Lacking  an  experimental  design,  in  which  individua 
are  randomly  assigned  to  participant  and  control  groups,  a  comparison 
group  strategy  is  a  next-best  approach.  (The  problems  inherent  in  thi 
strategy  are  discussed  below.) 

There  are,  nonetheless,  important  limitations  to  these  data  bases. 
First,  they  are  not  targeted  on  specific  programs,  and  so  the  estimate 
of  aggregate  program  effects  may  lump  together  the  effects  of  effectiv 
and  ineffective  programs.  Second,  the  data  bases  (particularly  CLMS) 
limit  the  extent  to  which  one  can  take  account  of  the  effects  of  local 
labor  market  conditions.  And  third,  the  data  were  not  derived  from 
experiments  in  which  subjects  were  randomly  assigned  to  take  part  in  a 
program;  consequently,  the  estimates  of  program  effectiveness  require 
strong  assumptions  about  the  adequacy  of  model  specification  and 
matching  procedures  used  to  construct  synthetic  control  groups. 
Finally,  we  should  point  out  that  we  received  the  CLMS-based  reports  i 
draft  form  late  in  the  course  of  our  work,  and  thus  our  evaluation  of 
them  has  not  been  as  intensive  as  that  of  the  individual  YEDPA  reports 


Findings  From  the  CLMS 

The  data  from  the  CLMS  have  been  analyzed  by  researchers  from 
Westat,  Inc.  (who  concentrated  mainly  on  adult  participants  in  CETA) , 
SRI  International,  and  the  Urban  Institute.  For  youth  participants  ir 
CETA  programs,  Westat  (1984)  reported  that  youth  work-experience 
programs  have  statistically  insignificant  effects  on  employment  and 
earnings  for  all  cohorts  and  all  postprogram  years  and  did  not  report 
other  specific  youth-related  findings.  The  Urban  Institute  (Bassi  et 
al. ,  1984:47),  however,  characterizes  Westat 1 s  results  from  earlier 
reports  as  follows: 

In  looking  at  youth,  Westat  (1982)  has  found  that  for  those 
youngsters  14  to  15  years  old,  CETA  has  had  little  overall 
impact.  For  other  young  workers  net  gains  are  found,  being 
highest  once  again  for  OJT  [on-the-job  training] ,  followed  by 
PSE  [public  service  employment]  and  classroom  training,  and 
being  negligible  for  work  experience.  The  results  found  for 
young  workers  also  tend  to  persist  in  the  second  postprogram 
year.  Westat  (1981)  also  produced  a  technical  paper  focusing 
on  youth  in  CETA  in  which  net  gains  were  broken  down  by  sex. 

As  with  adults,  net  gains  were  greatest  for  young  females, 
being  negligible  or  insignificant  for  males.  After  classifying 
youth  according  to  their  attachment  to  the  labor  force,  net 
earnings  gains  were  found  to  be  greatest  among  structurally 
unemployed  or  discouraged  workers . 


ie r  than  Westat's  [as  summarized  by  the  Urban  Institute  (Bassi  et 
,  1984)],  for  both  adults  and  youths,  and  the  authors  spend  con- 
lerable  time  in  identifying  the  sources  of  the  differences.  From 
iir  analyses,  the  SRI  authors  conclude  that  most  of  the  differences 
ild  be  attributed  to  choices  made  in  the  sampling  frame  and  to  an 
lating  of  1979  Social  Security  earnings. 

SRI's  findings  for  1976  CETA  enrollees  were  as  follows: 

•  Participation  in  CETA  results  in  significantly  lower  post- 
>gram  earnings  for  adult  men  (-$690)  and  young  men  (-$591)  and 
tistically  insignificant  gains  for  adult  women  (+$13)  and  young 
len  (+$185)  . 

•  All  program  activities  have  negative  effects  for  men,  while 

It  women  benefit  from  Public  Service  Employment  and  young  women  from 
■the-job  training.  Work  experience  has  negative  effects  for  all  age 
1  sex  groups. 

•  Both  male  and  female  participants  are  more  likely  to  be 
>loyed  after  CETA,  but  males  are  less  likely  to  be  in  high-paying 
>s  or  to  work  long  hours. 

•  Length  of  stay  in  the  program  has  a  positive  impact  on 
Jtprogram  earnings,  with  turning  points  for  young  men  at  8  months  and 

young  women  at  1  month. 

•  Placement  on  leaving  the  program  leads  to  positive  earnings 
:ns. 


The  Urban  Institute  (Bassi  et  al.,  1984)  report  focuses  separately 
youths.  The  analysts  used  Westat's  match  groups  from  the  Current 
aulation  Survey  (CPS)  and  estimated  net  effects  for  six  race/sex 
>ups:  male/female  by  white/black/Hispanic.  Both  random-effects 
:imators  and  fixed-effects  estimators  were  used  to  identify  net 
iects,  but  the  emphasis  was  on  fixed-effects  models  to  control  for 
Lection  bias.  Net  effects  were  estimated  for  two  postprogram  years, 
r8  and  1979  (see  Appendix  D: Table  D.2)  . 

The  Urban  Institute  found  the  following: 

•  Significant  earnings  losses  for  young  men  of  all  races  and  no 
jnificant  effects  for  young  women,  with  effects  persisting  into  the 
:ond  postprogram  year. 

•  For  Public  Service  Employment  and  on-the-job  training, 
jnificant  positive  net  effects  for  young  women,  particularly 
lorities . 

•  For  work  experience,  significant  negative  or  insignificant  net 
iects  for  all  groups. 

•  Among  groups,  the  most  negative  findings  were  for  white  males, 

2  most  positive  for  minority  females. 

•  Older  youths  (22-year-olds)  and  those  who  had  worked  less  than 
arter  time  had  stronger  gains  or  smaller  losses  than  the  younger 
>up  or  those  who  had  worked  quarter  time  or  more. 


•  Earnings  gains  resulted  primarily  from  increased  time  in  the 
labor  force,  time  employed,  and  hours  worked  rather  than  from  increas 
average  hourly  wages. 


Findings  From  the  NLS 

Two  studies  have  used  the  NLS  data  base  to  make  estimates  of  the 
aggregate  effects  of  government-sponsored  employment  and  training 
programs  on  youths.  One  study  (Moeller  et  al.,  1983)  was  conducted  b 
the  Policy  Research  Group  (PRG)  of  Washington,  D.C.?  the  second  study 
(Hahn  and  Lerman,  1983)  was  conducted  by  the  Center  for  Employment  an 
Income  Studies  (CEIS)  of  Brandeis  University.  Both  studies  evaluated 
the  effects  of  CETA  programs  on  youths  although  the  PRG  study  expande 
its  scope  to  include  such  schooling  programs  as  vocational  education. 

The  estimates  made  by  both  studies  indicate  relatively  modest 
effects  of  employment  and  training  programs  on  the  subsequent  income, 
employment  status,  and  educational  attainments  of  the  youths  who 
participated  in  those  programs.  For  CETA  programs,  both  studies  find 
negative  overall  effects  of  CETA  on  employment,  although  PRG  reports 
some  positive  effects  at  2  years  after  CETA  completion.  Reviewing  th 
PRG  results  and  their  own  findings,  Hahn  and  Lerman  (1983:84)  note: 

To  conclude,  both  the  PRG  results  and  our  own  show  negative  and 
significant  effects  of  CETA  on  employment  variables.  It  is 
only  after  going  out  two  years  in  time  after  CETA  completion 
that  the  PRG  report  finds  evidence  of  a  positive,  significant 
effect  and  that  on  only  one  variable,  unsubsidized  earnings. 

We  cannot  confirm  this  positive  effect,  but  it  would  not  be 
inconsistent  with  our  results.  It  is  difficult  to  claim  this 
as  an  impressive  success  for  CETA. 

The  substantive  findings  from  these  NLS  analyses  are  generally 
consistent  with  the  weak  and  generally  negative  findings  from  the  CLM 
analyses,  and  we  therefore  do  not  review  them  in  great  detail  here. 


Limitations  to  the  Findings: 

Bias  in  Estimates  of  Effectiveness 

Across  the  three  CLMS  studies,  there  is  a  pattern  of  preponderant 
negative  net  effects  on  youths,  and  the  NLS  studies  show  extremely  we 
effects  of  program  participation.  These  results  obviously  invite  the 
conclusion  that  federally  funded  employment  and  training  programs  hav 
had  (in  the  aggregate)  either  little  effect  or  a  deleterious  effect  c 
the  future  earnings  and  employment  prospects  of  the  youths  who  par¬ 
ticipated  in  the  programs.  There  is,  however,  empirical  evidence  tha 
suggests  that  these  estimates  may  be  biased. 

The  evidence  indicates  that  despite  various  intensive  efforts  to 
select  comparison  groups  that  are  similar  to  participants  in  youth 
programs  and  to  control  for  selection  bias  through  the  use  of  fixed- 


effects  estimators,  there  may  still  be  persistent  and  systematic  (but 
unmeasured)  differences  in  the  earnings  profiles  of  comparison  groups 
and  true  controls.  Such  earnings  differences,  for  example,  might  be 
due  to  such  unobserved  factors  as  (perceived  or  actual)  differences 
between  program  participants  and  a  constructed  comparison  group  in 
social  attitudes,  motivation,  or  ability. 

A  study  by  Mathematica  (1984)  provides  important  evidence  on  the 
potential  for  bias  in  the  use  of  matching  strategies  such  as  those 
employed  in  the  NLS  and  CLMS  analyses  reviewed  above.  The  Mathematica 
study  used  data  from  a  true  experimental  design  that  randomly  assigned 
youths  to  be  either  program  participants  or  controls  (the  Supported 
Work  program) .  it  then  compared  net-impact  estimates  derived  using  the 
experimental  design  with  estimates  derived  using  the  same  sample  of 
program  participants  but  substituting  various  "matched  samples"  con¬ 
structed  from  the  Current  Population  Survey.  The  comparison  groups 
were  constructed  in  a  manner  designed  to  simulate  those  used  by  the 
analysts  working  with  the  CLMS  data. 

Using  the  true  control  group,  Mathematica  found  in-program  earnings 
gains  and  negligible  postprogram  effects  for  youths.  Using  the 
constructed  matched  samples,  however,  yielded  either  insignificant  or 
significantly  negative  effects.  Mathematica  argues  that  biases  in  the 
estimates  of  program  effectiveness  are  likely  to  exist  in  other  studies 
that  use  similar  comparison  group  strategies,  which  include  the  Westat, 
SRI,  and  Urban  Institute  studies  using  the  CLMS  and  the  studies  based 
on  the  NLS. 

A  further  finding  of  the  Mathematica  review  is  the  substantial 
variability  in  estimates  made  using  different  matching  strategies  on 
the  same  data.  Not  only  do  the  estimates  derived  from  a  true  control 
group  differ  substantially  from  those  derived  from  a  constructed  match 
sample,  but  the  estimates  of  net  impact  derived  using  different 
matching  strategies  also  differ  substantially,  from  approximately  +$122 
to  -$1,303  (see  Appendix  D) .  Given  such  a  broad  range  of  estimated 
effects  and  the  sensitivity  of  estimated  program  effects  to  alternative 
assumptions,  there  must  be  cause  for  concern  about  the  nature  of  the 
underlying  data. 

While  one  may  argue  about  the  generalizability  of  the  Mathematica 
demonstration  of  bias  and  variability  in  the  matched  sample  methodology 
the  finding  has  a  precedent  in  the  analysis  of  the  Salk  polio  vaccine 
trials  (Meier,  1972).  The  Mathematica  study  highlights  two  separate 
problems  in  net-impact  estimations  using  a  matched  comparison  group: 

(1)  the  extent  to  which  employment  and  training  programs  recruit  or 
attract  participants  who  differ  from  eligible  nonparticipants  in  ways 
that  affect  subsequent  earnings,  and  (2)  the  extent  to  which  such 
differences  can  be  detected  and  controlled  using  available  demographic 
or  preprogram  earnings  data.  Youths  present  a  particularly  difficult 
problem  for  any  such  matching  strategy  since  preprogram  earnings  data 
either  do  not  exist  or  are  not  reliable  indicators  of  the  uncontrolled 
variables  that  are  of  interest  to  program  evaluators. 

Estimates  of  the  magnitude  and  direction  of  the  bias  in  matched- 
group  evaluations  are  only  available  for  the  one  youth  program 
(Supported  Work)  whose  experimental  data  were  reanalyzed  by  Mathematica 


From  this  reanalysis  we  have  an  elegant  demonstration  of  the  fact  th 
commonly  used  matched  comparison  group  strategies  have  yielded  an 
inappropriately  negative  evaluation  when  the  experimental  data  indie 
that  the  program  had  a  null  impact. 

There  is  a  natural  temptation  on  the  basis  of  this  one  result  to 
conclude  that  biases  equal  in  magnitude  and  direction  affect  other 
comparison  group  studies.  However,  there  is  too  little  evidence  to 
warrant  such  a  generalization.  All  we  know  for  certain  is  that  the 
potential  for  substantial  bias  exists  in  studies  that  use  matching 
techniques  rather  than  random  assignment  and  that  when  such  biases  d 
occur  they  can  lead  to  serious  errors  of  inference.  (Of  course,  bia 
in  either  direction  are  theoretically  possible.) 

Until  further  work  is  done,  there  will  be  considerable  uncertain 
as  to  the  extent  to  which  the  Mathematica  finding  generalizes  to  oth 
program  evaluations  and  to  different  populations  of  youths.  In  orde 
to  obtain  the  requisite  data,  there  will  have  to  be  a  renewed 
commitment  to  randomized  experiments  so  that  estimates  of  the  magnit 
and  direction  of  these  biases  can  be  made. 


YEDPA  STANDARDIZED  ASSESSMENT  SYSTEM 

A  national  data  base  different  in  major  respects  from  the  CLMS  a 
NLS  was  established  by  the  Educational  Testing  Service  under  the 
auspices  of  the  Office  of  Youth  Programs.  A  key  element  of  YEDPA" s 
knowledge  development  strategy  called  for  the  establishment  of  a 
standardized  system  for  the  systematic  collection  of  data  on  the 
progress  of  program  participants  and  the  services  provided  by  YEDPA 
programs.  The  intent  of  YEDPA" s  data  gathering  was  to  provide  a 
standardized  data  base  with  which  to  assess  the  performance  of  the 
various  YEDPA  demonstration  projects. 

This  data  collection  plan  was  called  the  Standardized  Assessment 
System  (SAS) .  It  was  intended  to  provide  preprogram,  postprogram,  e 
follow-up  (after  3  and  8  months)  data  for  all  youths  enrolled  in  YEE 
demonstration  programs.  The  data  collected  by  SAS  included  an  intafc 
interview,  a  reading  test,  and  seven  scales  designed  to  measure  occi 
tional  knowledge,  attitudes,  and  related  skills.  In  addition,  proc€ 
data  were  collected  from  program  sites  concerning  the  implementatior 
the  programs  and  the  services  offered  at  those  sites. 

In  order  to  investigate  the  characteristics  of  the  SAS  data  base 
we  obtained  a  copy  of  the  data  base  (minus  individual  identifiers)  . 
Appendix  A  presents  in  detail  our  assessment  of  its  sampling  adequac 
measurement  reliability,  and  measurement  validity.  Overall,  this 
analysis  suggests  that  sample  coverage  was  poor  and  subsequent  attri 
rates  were  extremely  high.  Using  program  operators'  reports  of 
enrollment  at  166  sites  to  estimate  the  size  of  the  target  sample  fc 
those  sites,  we  found  that  the  majority  of  the  target  sample  was  mif 


entirely.1  This  sample  coverage  problem  was  compounded  by  high 
attrition  over  time:  at  3  months  postprogram  more  than  40  percent  of 
the  initial  sample  had  been  lost.  In  addition,  our  examination  of  the 
attitude  and  knowledge  measurements  in  the  SAS  data  base  indicated  that 
those  measures  had  low  levels  of  stability  over  time  and  that  they  were 
only  weakly  correlated  with  subsequent  success  in  the  job  market. 

The  problems  evident  in  our  examination  of  the  SAS  data  collection 
effort  invite  the  question  of  how  this  might  be  avoided  in  the  future. 
In  Chapter  1  we  present  a  number  of  specific  recommendations  in  this 
regard.  There  are,  however,  two  more  general  lessons  that  should  be 
learned  from  this  experience. 

First,  the  scope  of  a  research  effort  should  match  the  resources 
available.  In  the  case  of  SAS,  it  is  questionable  whether  any  research 
purpose  required  that  data  be  gathered  from  all  participants  at  all 
sites,  but  in  any  event,  the  available  resources  were  inadequate  for 
such  a  task.  Well-collected  data  on  a  sample  of  participants  or 
program  sites  would  have  been  much  better  than  the  ambitious  but  poorly 
executed  data-gathering  strategy  used  by  SAS. 

The  second,  and  related,  lesson  concerns  the  dangers  of  using 
program  operators  to  collect  research  data.  Collection  of  research 
data  in  a  longitudinal  study  is  a  demanding  task.  Like  all  survey  data 
collections,  it  requires  vigorous  follow-up  efforts  to  obtain  data  from 
persons  who  initially  refuse  to  be  interviewed  or  who  are  hard  to 
reach.  It  also  requires  continued  contact  with  respondents  over  time 
so  as  to  minimize  attrition,  together  with  careful  efforts  to  trace 
persons  who  move.  While  it  may  seem  economical  to  use  program 
personnel  for  such  tasks,  the  experience  of  SAS — and  other 
efforts — suggests  that  it  is  a  false  economy. 


xThis  estimate  is  derived  from  reported  enrollments  for  sites  that 
provided  process  data  for  the  SAS.  Of  the  458  sites  that  provided 
participant  data,  only  166  also  provided  such  process  data.  Obviously 
it  is  not  possible  to  tell  whether  sites  that  did  not  provide  such 
process  data  had  higher  or  lower  rates  of  sample  coverage  than  sites 
that  did  provide  process  data. 
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Standardized  Data  Collection  for  Large-Scale  Program 
Evaluation:  An  Assessment  of  the  YEDPA-SAS  Experience 

Charles  F.  Turner 


The  Youth  Employment  and  Demonstration  Projects  Act  (YEDPA) ,  as 
oted  in  Chapter  3,  provided  the  Department  of  Labor  (DOL)  and  its  new 
£fice  of  Youth  Programs  (OYP)  with  a  mandate  to  test  the  relative 
fficacy  of  different  methods  of  dealing  with  the  employment  problems 
£  young  Americans.  The  legislative  concern  with  learning  "what  works 
or  whom"  was  consistent  with  the  frequently  stated  contention  that 
ecades  of  federal  funding  for  similar  programs  had  not  yielded  much  in 
e  way  of  reliable  knowledge.  And  so,  a  key  element  of  YEDPA' s 
nowledge  development  strategy  was  the  establishment  of  a  standardized 
stem  for  the  systematic  collection  of  data  on  the  progress  of  program 
articipants  and  the  services  provided  by  YEDPA  programs. 


STANDARDIZED  ASSESSMENT  SYSTEM 

In  order  "to  document  administrative  outcomes,  to  monitor  per- 
ormance,  and  to  continually  assess  program  impacts  and  lessons"  from 
EDPA  programs,  the  Office  of  Youth  Programs  launched  a  large-scale 
ata  gathering  operation  in  collaboration  with  the  Educational  Testing 
rvice  (ETS) .  The  intent  of  the  data  gathering  was  to  develop  a 
tandardized  data  base  with  which  the  performance  of  the  various 
ograms  that  YEDPA  comprised  could  be  assessed.  This  data  gathering 
lan,  called  the  Standardized  Assessment  System  (SAS) ,  was  ambitious  in 
ts  aim.  SAS  was  intended  to  provide  preprogram,  postprogram,  and 
ollow-up  data  (3  and  8  months  after  program  completion)  for  almost  50 
rcent  of  the  youth  served  by  these  programs  (Taggart,  1980) . 

The  SAS  data  base  is  an  important  component  of  the  YEDPA  knowledge 
velopment  enterprise  not  only  because  it  was  a  salient  feature  of  the 
EDPA  effort,  but  also  because  it  provided  the  basic  data  used  in 
valuating  a  large  number  of  the  YEDPA  programs.  The  characteristics 
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the  SAS  data  collection  procedures  and  evaluate  the  characteristics 
the  data  obtained,  e.g.,  the  coverage  of  the  sample  and  the  reliabi 
and  validity  of  the  measurements. 


Data  Collection  Instruments 

The  SAS  data  collection  instruments  included  an  intake  intervie 
called  the  Individual  Participant  Profile  (IPP)  ;  a  reading  test  ( S*3 
a  battery  of  seven  measures  of  occupational  knowledge,  attitudes,  a 
related  skills  administered  preprogram  and  postprogram;  a  program 
completion  interview;  interviews  at  3  and  8  months  postprogram;  anc 
evaluations  by  counselors  (postprogram)  and  employers  or  work  super 
visors  (postprogram  and  3  and  8  months  later).  In  addition,  data  vi 
collected  from  program  sites  concerning  the  implementation  of  the 
program  and  the  services  offered,  and  data  were  also  collected  fron 
"control"  groups  recruited  by  program  operators  to  provide  comparis 
samples  for  program  evaluation. 

In  this  section  each  of  the  data  collection  instruments  is  brie 
described.  The  descriptions  of  the  instruments  are  taken  from  The 
Standardized  Assessment  System  for  Youth  Demonstration  Projects 
(Educational  Testing  Service,  1980).  Where  suitable  we  have  used  t 
ETS  phrasing  or  paraphrased  the  descriptions  without  repeated  citat 
of  the  source. 


Individual  Participant  Profile 

The  Individual  Participant  Profile  was  used  to  record  informat: 
on  49  participant  characteristics  as  well  as  status  while  in  the 
program  and  at  termination.  These  data  essentially  duplicated  the 
standard  information  gathered  on  each  participant  in  all  Comprehens 
Employment  and  Training  Act  (CETA)  programs.  The  first  29  items  w< 
largely  demographic,  covering  such  information  as  the  individual's 
sex,  race,  and  economic,  educational,  and  labor-force  status — all  c 
time  of  entry  into  the  youth  program.  The  remaining  20  items  were 
"program  status"  items,  which  indicated  the  status  of  the  particip< 
at  the  time  of  program  completion  or  termination.  These  included  £ 
information  as  entry  and  termination  dates,  total  hours  spent  in  tl 
program,  whether  the  program  provided  the  participant  with  academic 
credit,  and  specific  forms  of  "positive"  and  "non positive" 
termination.  (A  set  of  definitions  accompanying  the  IPP  form  defii 
each  item  in  some  detail  and  how  it  was  to  be  completed  by  the  you 
program  project  personnel  from  their  project  records.) 


STEP  Reading  Scale 

The  STEP  reading  scale  was  a  short  (10  to  15  minutes)  measure  < 
reading  skill  that  was  intended  to  cover  the  wide  range  of  reading 


levels  found  among  the  YEDPA  enrollees  (approximately  fourth  to  ninth 
grade  reading  level  by  ETS's  estimate) .  Twenty  items  were  selected 
from  the  STEP  locator  tests  covering  fourth  to  ninth  grade  reading 
levels.  Those  locator  tests  are  short  reading-comprehension  measures 
ordinarily  used  as  screening  devices  for  deciding  which  level  of  the 
full  STEP  achievement  tests  is  suitable  for  administration. 


Job  Knowledge  and  Attitudes  Battery 

Measures  chosen  for  incorporation  in  the  Job  Knowledge  and 
Attitudes  battery  were  intended  to  reflect  YEDPA  program  objectives 
while  still  being  compatible  with  the  characteristics  of  the  trainee 
population  and  the  operational  constraints  of  the  youth  projects.  As  a 
starting  point,  five  behavioral  areas  thought  to  be  affected  by  YEDPA 
program  participation  were  defined  by  the  Office  of  Youth  Programs. 
These  were  considered  to  encompass  the  objectives  of  a  vast  majority  of 
the  YEDPA  projects  and  were  designated  as  (1)  career  decision  making, 
awareness,  and  capability,  (2)  self-image,  (3)  work  attitudes,  (4)  job 
search  capability,  and  (5)  occupational  sex  stereotyping. 

Criticism  of  the  design  and  administration  of  conventional  paper- 
and-pencil  tests  used  with  similar  youth  led  SAS  designers  to  seek 
measures  that  were  relatively  short,  presented  orally,  pictorial  as 
well  as  verbal,  and  appropriate  in  level  and  style  of  language  for 
adolescents  or  young  adults  of  low  reading  skill.  In  addition  the 
battery  allowed  the  item  responses  to  be  marked  directly  in  the  test 
booklet.  Examples  of  items  from  each  of  the  Job  Knowledge  and 
Attitudes  battery  are  shown  in  Figure  A.l. 

The  designers  of  SAS  chose  two  measures  to  assess  what  they  termed 
career  decision  making,  awareness,  and  capability  performance.  One 
measure  dealt  with  the  "vocational  maturity"  of  adolescents  in  making 
appropriate  career  decisions,  and  the  other  with  the  youth's  knowledge 
of  what  is  required  for  carrying  out  different  jobs. 


Vocational  Attitude  Scale  This  scale  contained  30  verbal  items,  which 
were  scorable  as  three  10-item  subscales.  Those  scales  were  designated 
as  "Decisiveness,"  "Involvement,"  and  "Independence"  in  career  decision 
making.  The  respondent  indicated  his  or  her  agreement  or  disagreement 
with  each  of  30  statements  about  vocational  careers  and  employment. 


Job  Knowledge  Test  This  33-item  scale  dealt  with  the  qualifications, 
requirements,  and  tasks  involved  in  various  jobs.  The  items,  in 
multiple-choice  format,  required  the  respondent  to  indicate  the  correct 
response  to  questions  about  the  specific  occupations  depicted. 


Self-Esteem  Scale  Youth  programs  often  seek  to  enhance  the 
participant's  feelings  of  personal  value,  or  self-worth,  with  the 
expectation  that  improved  self-perception  will  stimulate  more 
success-oriented  social  and  vocational  adjustment  behaviors.  The  SAS 


SOURCE:  Educational  Testing  Service  (1980) 
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designers  included  one  measure  that  attempted  to  define  the  level  at 
which  the  program  participant  rated  his  or  her  personal  value.  The 
self-esteem  scale  was  a  15-item  scale  containing  pictorial  and  verbal 
material  used  to  assess  perceived  self-worth  in  terms  of  expectations 
for  acceptance  or  achievement  in  various  social,  vocational,  and 
educational  settings.  The  respondent  indicated,  on  a  three-point 
scale,  the  degree  to  which  he  or  she  would  be  successful  or  receive 
acceptance  in  the  specific  situation  portrayed. 


Work-Related  Attitudes  Inventory  This  inventory  was  intended  to 
measure  the  youth's  views  about  jobs,  the  importance  of  working, 
appropriate  ways  of  behaving  in  job  settings,  and  general  feelings 
about  his  or  her  capabilities  for  succeeding  in  a  work  situation.  Th 
inventory  contained  16  items  that  provided  both  a  total  score  and 
scores  for  three  subscales  defined  as  "Optimism,1'  "Self-Confidence," 
and  "Unsocialized  Attitudes."  The  response  to  each  of  the  attitudina 
statements  was  based  on  a  four-point  scale  of  degree  of  agreement  wit 
or  applicability  of,  the  statement. 


Job  Holding  Skills  Scale  This  scale  dealt  with  respondent  awareness 
appropriate  on-the-job  behaviors  in  situations  involving  interaction 
with  supervisors  and  coworkers.  This  11-item  scale,  containing 
pictorial  and  verbal  material,  required  the  respondent  to  indicate 
which  one  of  three  alternatives  best  defined  what  his  or  her  response 
would  be  in  the  situation  described.  (Response  alternatives  were 
scaled  in  terms  of  "most"  to  "least"  acceptable  behaviors  for 
maintaining  employment.) 


Job  Seeking  Skills  Test  This  test  was  intended  to  measure  elementary 
skills  essential  for  undertaking  an  employment  search.  This  test  had 
17  items  that  sampled  some  of  the  skills  needed  to  initiate  an 
employment  search,  interpret  information  about  prospective  jobs  (in 
newspaper  want  ads) ,  and  understand  the  information  requirements  for 
filling  out  a  job  application.  The  items,  in  a  multiple-choice  forma 
required  selection  of  the  one  correct  response  to  each  question. 


Sex  Stereotyping  of  Adult  Occupations  Scale  This  scale  attempted  to 
measure  attitudinal  perceptions  of  sex  roles  in  occupational  choice. 
This  relatively  short  (21  item)  verbal  scale  presented  job  titles  ale 
with  a  one-sentence  description  of  each  job  and  required  the  responde 

to  indicate  "who  should  be  a  _ "  (job  title  as  given).  A 

five-point  response  scale  ranged  from  "only  women"  to  "only  men." 


Project  and  Process  Data 

In  addition  to  the  range  of  information  collected  on  program 
participants  and  controls,  the  SAS  attempted  to  measure  the  types  of 


activities,  the  progress  of  program  implementation,  and  the  range  of 
services  being  offered  at  each  program  site.  This  information  was 
expected  to  be  of  potential  use  not  only  as  contextual  data  for  the 
analysis  of  program  outcomes,  but  also  as  data  for  reports  to  managers 
and  policymakers  about  the  implementation  of  the  various  YEDPA  programs. 

The  Project  and  Process  Information  questionnaire  contained  six 
sets  of  questions  that  reported  on  key  site-specific  variables  in 
quantitative  terms.  First,  basic  information  was  gathered  about  the 
site,  setting,  and  sponsors  of  the  project.  Second,  the  project  was 
described  in  terms  of  its  services,  activities,  and  goals.  Third,  the 
linkages  involved  in  the  project  were  described.  Fourth,  the  staff 
involved  in  the  project  were  profiled.  Fifth,  the  project  stability 
and  the  position  of  the  project  on  the  learning  curve  were  assessed. 
Finally,  the  project  costs  were  measured. 


Outcome  Measures 

The  outcomes  of  the  programs  were  measured  at  program  completion 
and  3  and  8  months  after  program  departure.  Two  questionnaires  were 
used  for  this  purpose:  the  "Program  Completion  Survey"  and  the 
"Program  Follow-up  Survey."  (The  same  instrument  was  used  3  and  8 
months  postprogram.) 


Program  Completion  Survey  This  questionnaire  contained  48  items,  most 
of  which  were  phrased  as  questions  to  be  presented  to  the  youth  at  the 
time  he  or  she  had  completed  or  was  leaving  the  training  program.  They 
covered  the  participant's  activities  in  the  program,  attitudes  about 
the  program,  job  and  educational  aspirations,  and  expectations  and 
social-community  adjustments.  The  questions  were  intended  for  oral 
presentation  to  the  individual  by  an  interviewer.  (A  parallel 
questionnaire  containing  similar  material  was  designed  for  use  with 
control  group  members  and  was  designated  the  "Control  Group  Status 
Survey . ") 


Program  Follow-up  Survey  This  50-item  questionnaire  was  designed  to  be 
administered  orally  to  the  individual  by  an  interviewer,  who  also 
recorded  the  participant's  responses.  The  survey  was  intended  for  use 
3  months  after  the  participant  had  left  the  training  program  and  again 
at  8  months  following  program  participation.  Questions  dealt  with  the 
former  participant's  posttraining  experiences  in  areas  of  employment, 
education,  social  adjustments,  and  future  plans.  (A  parallel  version 
of  the  follow-up  survey  was  used  with  control  group  members  and  was 
designated  the  "Control  Group  Follow-up  Survey.")  In  addition,  a 
five-item  Employer  Rating  Form  was  to  be  completed  by  the  present  (or 
most  recent)  employer.  (Permission  to  interview  the  employer  had  to  be 
granted  by  the  youth.) 


Concerns  about  Instrument  Reliability  and  Validity 

In  introducing  the  SAS  measuring  instruments,  the  designers  at  th< 
Educational  Testing  Service  warned  that  (Educational  Testing  service, 
1980) 

more  careful  testing  of  the  instruments  would  have  been 
preferable  but  it  was  necessary  to  develop  these  measures  while 
implementing  certain  programs.  The  instruments  .  .  .  represent 
the  best  possible  compromise  between  the  many  constraints  at 
the  time  the  system  was  implemented. 

A  particular  concern  expressed  by  the  SAS  designers  involved  the 
nature  of  the  youth  population  from  whom  data  were  being  collected. 
Given  a  population  characterized  as  economically  disadvantaged  and 
largely  products  of  inner-city  school  systems,  they  anticipated  that 
the  validity  of  any  available  paper -and -pencil  test  might  be  suspect. 
For  this  reason  the  documentation  of  the  SAS  instruments  stressed  the 
(1)  use  of  measures  that  employ  pictures  as  well  as  words,  (2)  use  of 
an  administrator  who  would  read  items  aloud  so  that  the  youth  could 
follow  along,  and  (3)  the  administration  of  the  tests  to  small  groups- 
so  that  literacy  (or  other)  problems  might  be  more  easily  detected. 

Despite  these  precautions,  it  can  never  be  assured  in  a  data 
gathering  operation  such  as  SAS  that  measurements  were  made  in  the 
manner  prescribed.  The  test  administrators  were  not  ETS  employees,  bi 
rather  program  personnel  assigned  to  fulfill  YEDPA's  "data  reporting" 
requirement.  While  ETS  did  provide  instruction  to  one  person  at  each 
program  site,  that  person  was  not  necessarily  the  one  who  administer  e< 
the  measurements.  Moreover,  staff  turnover  may  have  put  some  people  . 
the  position  of  serving  as  test  administrator  with  little  or  no  (or 
wrong)  instruction  on  how  to  administer  the  instruments.  Since  one  o 
the  canons  of  testing  is  that  the  manner  of  test  administration  can 
have  important  effects  on  measurement,  it  is  natural  that  concerns 
about  the  reliability  and  validity  of  the  SAS  measurements  were  voice' 
by  outsiders — as  well  as  by  ETS. 

Almost  all  of  the  SAS  scales  used  previously  published  tests,  and 
there  did  exist  a  literature  that  documented  the  characteristics  of  tl 
scales  and  estimated  their  reliability  and  predictive  validity  with 
various  populations.  These  populations,  however,  were  not  identical 
the  YEDPA  youth  who  would  be  tested  with  the  SAS.  Thus,  it  did  not 
necessarily  follow  that  the  readings  of  test  reliability  and  validity 
obtained  from  these  groups  could  be  generalized  to  the  youth  populati 
targeted  by  YEDPA. 

In  its  1980  report  on  the  Standardized  Assessment  System,  ETS 
presented  evidence  for  the  reliability  and  validity  of  the  SAS 
scales.1  Some  of  this  evidence  predates  YEDPA  and  may  have  been  used 


1 ETS  (1980)  presents  estimates  of  reliability  and  validity  in  cases 
where  there  are  "significant"  results  (p  less  than  .01  or  p  less  than 


in  the  decision  making  about  which  instruments  to  use  in  SAS.  The 
evidence  is  derived  from  studies  of  small  samples  of  youths 
participating  in  Neighborhood  Youth  Corps  (NYC)  and  Opportunities 
Industrialization  Center  (OIC)  training  programs.  For  four  of  the  SAS 
scales,  Table  A.l  presents  the  correlations  found  between  scale  scores 
and  various  criteria  of  "success"  in  these  programs.  Reported 
correlations  range  from  .18  to  .36.  Two  measures  show  significant 
correlations  with  success  in  finding  employment  after  program 
completion — the  Job  Knowledge  scale  (r  =  .22  in  NYC  sample)  and  the  Job 
Search  Skills  scale  (r  =  .36  in  NYC  sample,  and  .21  in  OIC  sample). 

The  other  two  scales.  Job  Holding  and  Self-Esteem,  do  not  show 
significant  associations  with  postprogram  employment,  but  do  show 
positive  associations  with  evaluations  given  by  guidance  counselors  and 
work  training  supervisors. 

The  1980  report  on  SAS  also  provides  early  SAS  data  from  samples  of 
high  school  seniors  participating  in  the  Youth  Career  Development 
project  (n  =  1,666)  and  their  control  group  (n  =  1,590).  Estimates  of 
predictive  validity  using  selected  criterion  measures  (and  Cronbach's 
alpha  for  the  scales)  are  shown  in  Table  A. 2.  The  range  of  correlations 
for  this  sample  are  generally  lower  than  those  found  in  the  earlier 
studies.  In  particular,  only  two  scales  (Vocational  Attitudes  and 
Work-related  Attitudes)  show  significant  correlations  with  postprogram 
activity  (coded  2  for  full-time  school  or  work,  1  for  part-time  school 
or  work,  and  0  otherwise) .  These  correlations  were  very  modest  in  size 
(r  =  .12  and  .10).  The  scales  did  show  somewhat  higher  correlations 
with  level  of  present  job  and  a  negative  correlation  with  amount  of 
time  required  to  find  the  present  job. 

Overall,  however,  the  preliminary  evidence  presented  by  ETS 
suggests  that  (1)  the  seven  scales  are  not  powerful  predictors  of 
postprogram  employment  and  (2)  the  measurement  characteristics  of  these 
scales  when  administered  in  SAS  may  be  different  from  those  found 
elsewhere.  (Whether  the  latter  might  be  a  function  of  the  population 
tested,  lack  of  standardization  in  administration,  or  some  other  cause, 
is  difficult  to  say.) 


.05).  Thus  it  is  not  possible  in  Table  A.l  and  A. 2  to  report  their 
estimates  for  all  variables  and  for  each  criterion  measure. 

In  selecting  ETS  "validity"  measures  to  reproduce  in  Table  A. 2  and 
in  designing  our  own  analyses  (reported  in  Table  A. 10  and  A. 12)  we  have 
focused  on  the  prediction  of  future  rather  than  concurrent  outcomes 
where  the  outcome  variables  involved  assessments  by  observers  other 
than  the  subject  (e.g.,  an  employer's  evaluation  of  the  subject  at  3 
months  postprogram)  or  involved  reports  of  relatively  objective 
statuses  (e.g..  Are  you  employed  full  time?).  We  believe  that  this 
procedure  provides  more  appropriate  information  about  the  usefulness 
(for  program  evaluation)  of  the  SAS  assessment  battery  than  procedures 
that  depend  exclusively  on  more  subjective  reports  from  the  respondent 
(e.g.,  assessments  of  job  satisfaction  or  adjustment). 


TABLE  A .  1  ETS  Estimates  of  Predictive  Validity  of  SAS  Attitude  and 
Knowledge  Measurements 


SAS 

Measurement  Criterion  Predicted  Sample  (n)  r 


Job  knowledge 

Work  supervisor  rating 

NYC 

(109) 

.32 

Counselor  rating 

NYC 

(109) 

.25 

Counselor  rating 

OIC 

(220) 

.19 

Vocational  skills  instructor 

rating 

OIC 

(261) 

.20 

Posttraining  employment 

NYC 

(104) 

.22 

Job  holding 

Counselor  rating 

NYC 

(HI) 

.31 

skills 

Work  supervisor  rating 

NYC 

(111) 

.34 

Vocational  skills  instructor 

rating 

OIC 

(260) 

.15 

Remedial  skills  instructor 

rating 

OIC 

(134) 

.18 

Job  seeking 

Counselor  rating 

NYC 

(111) 

.22 

skills 

Work  supervisor  rating 

NYC 

(111) 

.31 

Posttraining  employment 

NYC 

(104) 

.36 

Posttraining  employment 

OIC 

(157) 

.21 

Self-esteem 

Counselor  rating 

NYC 

(111) 

.34 

Work  supervisor  rating 

NYC 

(111) 

.24 

Remedial  skills  instructor 

rating 

OIC 

(134) 

.18 

SOURCE:  Educational  Testing  Service  (1980)  . 

CHARACTERISTICS  OF  THE  DATA  BASE 
Completeness  of  Initial  Coverage 

According  to  ETS,  the  Standardized  Assessment  System  was  designed 
to  provide  a  complete  enumeration  of  all  participants  (together  with 
appropriate  controls)  in  all  YEDPA  demonstration  projects.  In  their 
words  (Educational  Testing  Service,  1980): 

In  a  literal  sense  there  is  no  "sampling"  with  respect  to 
enrollees  at  a  demonstration  site  since  evaluation  data  are  to 
be  collected  on  the  performance  of  all  enrollees  at  a 
particular  site.  The  control  group  at  a  particular  site, 
however ,  does  represent  a  sample  from  a  hypothetical  population 
that  is,  hopefully,  similar  to  the  enrollees  with  respect  to 
important  background  and  ability  variables. 

The  difficult  task  of  ensuring  that  data  were  collected  in  a 
standardized  manner  from  all  program  participants  was  not,  however, 
under  the  control  of  ETS.  The  Department  of  Labor  had  arranged  for 
data  to  be  collected  by  individual  program  operators;  administration 


TABLE  A.  2  ETS  Estimates  of  Reliability  and  Predictive  Validity  of  SAS 
Instruments 


SAS  Measurement 

Internal 

Consistency 

(Alpha) 

Predictive  Validity 

Time  to  Find 
First  Job 

Activity 

Status 

Level  of 
Present  Job 

Vocational  attitudes 

.74 

b 

.12 

.21 

Job  knowledge 

.66 

b 

b 

.23 

Job  holding  skills 

.56 

-.16 

b 

.28 

Work-related  attitudes 

.78 

-.17 

.10 

.18 

Job  seeking  skills 

.66 

-.16 

b 

.24 

Sex  stereotyping 

.90 

-.26 

b 

.16 

Self-esteem 

.60 

-.17 

b 

.15 

NOTE:  Predictive  validity  estimates  are  for  3  months  postprogram  for  YCD 

participants.  Sample  sizes  range  from  120  to  790  for  validity  estimates. 
Reliability  estimates  are  average  of  values  reported  for  participants  and 
controls  (combined  n  =  3,256) . 

aActivity  status  coded  0  for  not  working  or  in  school,  1  for  part-time  work  or 
school,  and  2  for  full-time  work  or  school.  It  is  not  clear  from  the  text  how 
both  part-time  work  and  part-time  school  would  be  coded. 
bNot  significant. 

SOURCE:  Educational  Testing  Service  (1980)  . 


and  execution  of  the  data  collection  were  not  ETS's  responsibility. 

ETS  contracted  to  process  the  data  supplied  by  the  program  operators 
(and,  in  a  number  of  cases,  to  analyze  that  data)  .2  Indeed,  most  ETS 
discussions  of  the  SAS  data  base  contain  forceful  disclaimers  that 
"collection  of  all  data  with  the  Standardized  Assessment  System 
instruments  remained  the  sole  responsibility  of  the  service  delivery 
agents  who  were  required  to  assign  suitable  staff  at  each  project  site 
for  carrying  out  the  data  gathering  tasks"  (ETS,  1982:15,  emphasis  in 
original) . 

As  a  result  of  this  delegation  of  data  gathering  responsibility  to 
the  program  operators,  there  was  known  to  be  quite  incomplete  reporting 
of  data.  Although  the  precise  magnitude  of  the  incompleteness  of  the 
initial  coverage  was  not  known,  ETS  has  informally  speculated  that  up 
to  50  percent  of  the  program  participants  may  have  been  missed. 


2 ETS  involvement  in  the  data  collection  grew  out  of  evaluation 
studies  begun  by  N.  Freeberg  and  D.  Rock  of  Youth  Career  Development 
and  Service-Mix  Alternatives  projects. 


To  investigate  the  characteristics  of  the  SAS  data  base,  we 
obtained  a  copy  of  the  data  base  (minus  individual  identifiers).3 
Because  data  were  collected  from  program  sites  on  the  number  of  new 
persons  enrolled  each  month,  it  is  possible  to  gain  some  insights  into 
the  nature  and  magnitude  of  the  incompleteness  of  coverage.  Using  the 
"process  data"  provided  by  each  site,  we  tabulated  the  total  number  of 
persons  reported  to  be  enrolled  in  YEDPA  demonstration  programs.  We 
then  tabulated  data  on  individual  participants  by  site  to  obtain  an 
indication  of  the  proportion  of  enrollees  who  were  missing  from  the 
participant  file. 

As  with  all  attempts  at  complete  enumeration,  the  estimation  of 
undercoverage  is  not  straightforward  unless  there  exists  a  valid  count 
for  the  true  size  of  the  population  being  enumerated,  in  the  present 
case,  it  is  likely  that  the  month-by-month  counts  of  new  program 
entrants  were  figures  that  program  operators  had  readily  at  hand. 

(This  results  from  the  fact  that  payments  to  programs  are  tied  to  the 
number  of  entrants — which,  of  course,  introduces  its  own  potential  for 
distortions  in  reporting.)  If  we  take  the  reports  of  total  enrollments 
at  site  _i  (E^)  as  an  indicator  of  the  total  number  of  persons  who 
should  have  been  interviewed  and  tested,  then,  for  any  single  site,  the 
incompleteness  of  coverage  can  be  represented  by  the  ratio  (N-j/E^) 
where  Nj[  is  the  sample  count  in  the  participant  data  file  for  site 
i.  For  example,  if  a  site  said  it  enrolled  2,000  youth  but  only  1,200 
respondents  from  that  site  could  be  located  in  the  participant  file, 
then  the  coverage  rate  could  be  said  to  be  1,200/2,000  or  60  percent. 
(Note,  however,  how  inflating  of  enrollment  figures  by  program 
operators  or  mechanical  errors  in  data  entry  or  matching  might  bias 
this  estimate.) 

If  all  program  sites  accurately  reported  enrollment  data,  we  might 
then  make  a  confident  estimate  of  the  completeness  of  coverage  by 
summing  across  sites  (ZN-j/ZE^) .  The  data  do  not,  however, 
comply  so  readily  with  our  wishes,  incompleteness  affects  not  only 
participant  data,  but  also  the  process  data. 

Analysis  of  the  process  data  collected  from  individual  program 
sites  (shown  in  Table  A. 3)  reveals  that  the  majority  of  program  sites 
did  not  provide  data  on  their  program  operations.  This  can  be  detected 
within  the  ETS  data  base  because  site  codes  appear  on  both  respondent 
records  and  site  records.  We  thus  know  (assuming  the  site  codes  have 


3  Three  observations  should  be  made  about  technical  aspects  of  the 
data  sets.  First,  the  documentation  provided  with  the  data  sets  was 
not  always  adequate.  Second,  although  the  data  have  a  hierarchical 
structure  (there  are  respondents  within  sites  within  programs) ,  the 
data  sets  are  not  designed  to  encourage  analyses  that  make  use  of  that 
hierarchical  structure.  Third,  no  procedural  history  exists  for  the 
data  gathering.  Thus  it  is  unclear  how  many  sites  were  contacted  for 
data,  how  many  sites  provided  data  that  was  judged  "suspicious,"  how 
ETS  "winnowed"  the  data  set  to  eliminate  "suspicious"  data,  and  so 
forth. 


TABLE  A. 3  Cross-tabulation  of  Availability  of  Site  "Process"  Data  in 
YEDPA/SAS  Data  Base  by  Availability  of  Participant  Data 


Site  "Process"  Data 

Participant  Data 

Missing 

Repor  ted 

No  data 

Unknown 

24  sites 

(n  =  0)a 

(n  =  0)a 

Data  on  one  or  more 

participants  from  site 

292  sites 

166  sites 

(n  =  21,839  part. ) 

(n  =  12,733  part.) 

(n  =  8,774  cont.) 

(n  =  6,836  cont.) 

Total  reported  enrollment 

Unknown 

29,272  enrollees 

NOTE:  Numbers  in  parentheses  are  total  number  of  participant  (part.)  and 
control  (cont.)  cases  in  respondent  data  base  for  those  sites. 

aSites  provided  no  participant  or  control  data. 

been  accurately  recorded)  that  458  program  sites  provided  some  par¬ 
ticipant  data  to  ETS .  Of  those  458  sites  only  166  provided  "process" 
data  on  site  operations.  Not  only  do  these  "missing"  sites  constitute 
the  majority  of  identifiable  sites,  but  they  also  account  for  the 
majority  of  the  respondents  whose  data  were  supplied  to  ETS  (30,613  of 
50,182  respondents  in  the  data  base  came  from  sites  that  did  not  report 
"process"  data) . 

Some  partial  information  on  coverage  can  still  be  gleaned  from 
Table  A. 3.  Note,  for  example,  that  the  sites  providing  process  data 
reported  a  total  enrollment  of  29,272  participants.  For  these  same 
sites  we  find  only  12,733  cases  in  the  participant  file  (plus  6,836 
control  cases).  For  these  sites,  the  coverage  estimate  would  be 
12,733/29,272  or  43  percent.  (It  is,  of  course,  a  leap  of  faith  to 
assume  that  this  same  percentage  would  apply  to  the  sites  that  did  not 
provide  process  data,  but  it  is  not  inconsistent  with  the  informal 
"guesstimates"  made  by  ETS  personnel  who  were  familiar  with  the  SAS 
data  collection.) 


Sample  Attrition 

Subsequent  to  the  initial  data  gathering,  a  series  of  data  collec¬ 
tion  steps  were  planned  for  each  participant  (and  control)  in  the  SAS 
data  base.  Interviews  were  to  be  conducted  at  program  completion,  the 
Job  Knowledge  and  Attitudes  battery  was  to  be  re-administered,  subse¬ 
quent  survey  interviews  were  to  be  conducted  3  months  and  8  months 
after  program  completion,  and  data  were  to  be  gathered  from  employers, 
counselors,  and  so  on. 


succeeding  wave  of  data  gathering.  Such  sample  loss  may  compromise 
representativeness  of  the  remaining  sample  (save  in  the  rare  case  wl 
sample  loss  is  effectively  random).  Such  attrition,  however,  is  a  f 
of  life  that  social  researchers  have  to  live  with.  Respondents  move 
and  are  untraceable,  they  lose  their  patience  with  the  researchers’ 
persistent  inquiries,  and  so  forth.  Nonetheless,  it  is  not  unknown 
well-conducted  surveys  to  obtain  responses  from  80  percent  (or  more) 
the  original  interviewees  after  a  period  of  months  (and  even  years), 
Systematic  follow-up  and  dogged  determination  to  find  the  "movers"  c 
persuade  the  "refusers"  have  resulted  in  some  remarkably  low  attrit] 
rates  in  long-term  follow-up  studies,  even  with  very  youthful  populc 
tions  (see  Sewell  and  Hauser,  1975,  and  descriptions  of  the  Continue 
Longitudinal  Manpower  Survey  and  National  Longitudinal  Survey  in 
Appendix  D) . 

Table  A. 4  shows  the  various  stages  of  the  SAS  data  collection  ai 
the  attrition  that  occurred  over  time.  It  will  be  seen  from  Table  I 
that  the  attrition  in  the  SAS  data  collection  base  is  sufficiently  1 
to  engender  skepticism  about  claims  that  the  follow-up  data  provide 
reasonable  estimates  of  the  postprogram  experiences  of  the  youth  fr< 
whom  data  were  initially  collected  (not  to  mention  the  entire 
population  of  participants)  .** 

Looking  at  the  data  base  in  its  entirety  (i.e.,  including  all 
respondents  from  whom  any  data  were  collected)  reveals  that  at  8  mor 
after  program  completion,  there  is  no  interview  data  on  the  majority 
program  participants  and  controls  (see  Table  A. 4)  .  Even  at  3  months 
postprogram,  the  attrition  losses  amount  to  almost  half  of  the  orig: 
sample  (45  percent  of  program  participants  and  49  percent  of  contro] 
who  provided  initial  data  did  not  provide  interview  data  at  3  month! 
postprogram) . 

Sample  attrition  is  clearly  at  a  level  at  which  serious  doubts  i 
arise  about  whether  the  results  obtained  from  the  follow-up  samples 
be  generalized.  Even  for  postprogram  measurements,  attrition  rates 
rather  high:  32  percent  of  participants  lack  postprogram  survey 
data.5 


4  In  fact,  sample  attrition  in  the  data  base  is  higher  than  that 
reported  in  the  ETS  analyses.  This  difference  in  numbers  arises 
because  ETS  eliminated  approximately  11,000  cases  from  their  publisl 
figures  as  a  result  of  their  "winnowing"  of  the  sample  to  exclude 
"suspicious"  data. 

5  It  is  possible  that  some  portion  of  this  "loss"  may  be  attributabl 
to  youths  who  dropped  out  of  the  program  (rather  than  "completers" 
whom  data  are  missing)  .  If  this  is  so,  the  situation  may  not  be  qu 
so  bleak  as  it  seems,  since  one  could  attempt  to  cast  an  analysis  i 
terms  of  the  effects  of  program  completion  (rather  than  mere  enroll) 
in  a  YEDPA  program) . 
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aInstruraents  for  which  N's  are  included  in  Figure  A-l. 

^Instrument  not  applicable  to  all  respondents. 

cN's  shown  are  number  of  youths  in  sites  who  returned  Process  Information  Questionnaire. 


The  magnitude  of  the  attrition  in  the  ETS  data  base  makes  one  wond 
why  it  was  not  anticipated  either  by  the  agency,  the  contractor,  or  ti 
reviewers  at  the  Office  of  Management  and  Budget  (OMB)  who  were  respor 
sible  for  approving  government  data-gather ing  activities.  We  would 
note,  in  this  regard,  that  in  1977  OMB  announced  an  explicit  standard 
for  response  rates,  which  (temporarily)  replaced  its  non-numer ical 
standard  of  adequacy  (Office  of  Management  and  Budget,  1977): 

It  is  expected  that  data  collections  for  statistical  purposes 
will  have  a  response  rate  of  75  percent.  Proposed  data 
collections  having  an  expected  response  rate  of  less  than  75 
percent  require  a  special  justification.  Statistical  data 
collection  activities  having  a  response  rate  below  50  percent 
should  be  terminated.  Proposed  statistical  data  collections 
having  an  expected  response  rate  of  less  than  50  percent  will 
be  disapproved. 

Clearly,  under  such  a  standard,  this  data  collection  would  not  have 
been  approved  (or  re-approved)  if  the  attrition  rates  for  its  follow-i: 
measurements  had  been  accurately  anticipated. 

To  illustrate  the  cumulative  impact  of  the  incompleteness  of 
coverage  discussed  previously  and  the  sample  attrition  that  occurred 
over  time  in  the  SAS  data  base.  Figure  A. 2  graphs  an  estimate  of  the 
size  of  the  target  sample  of  participants  for  the  SAS  data  collection 
(using  the  43  percent  coverage  rate  computed  for  sites  reporting 
process  data)  together  with  the  sample  sizes  obtained  for  both  par¬ 
ticipants  and  controls  over  the  course  of  the  data  gathering.  The 
effects  of  undercoverage  and  sample  attrition  are  quite  dramatic. 

Because  this  sample  attrition  was  so  great  we  undertook  some 
exploratory  analyses  to  assess  its  effect  on  the  composition  of  the  Si 
samples  over  time.  Table  A. 5  presents  tabulations  of  a  variety  of 
economic  and  social  characteristics  for  respondents  who  provided 
interview  data  at  entry  and  at  3  and  8  months  postprogram.  A  few 
modest  trends  are  evident  from  Table  A.  5.  The  proportion  of  high 
school  dropouts  declines  from  25  to  20  percent,  while  the  proportion  c 
persons  receiving  public  assistance  shows  a  modest  rise  (42  to  47 
percent  for  participants  and  38  to  42  percent  for  controls)  .  While 
there  are  notable  changes  and  a  very  large  number  of  "significant" 
differences  (given  the  large  sample  sizes)  between  those  who  continue* 
to  provide  data  and  those  who  were  lost  to  attrition,  it  was  surprisii 
how  modest  the  changes  were.  When  a  parallel  analysis  was  performed  c 
the  Job  Knowledge  and  Attitude  measurements  (see  Table  A. 6),  the 
results  were  equally  unprovocative. 


Reliability  and  Validity  of  Instruments 

Job  knowledge  and  attitude  measures  figure  prominently  in  many  of 
the  evaluation  studies  conducted  under  YEDPA.  The  rationale  behind  tl 
use  of  such  instruments  is  that  they  measure  traits  that  (1)  the 
programs  change  and  that  (2)  are  important  in  helping  youths  find 
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FIGURE  A. 2  Sample  coverage  and  attrition  (Standardized  Assessment 
System) . 


employment.  Since  these  are  relatively  inexpensive  data  to  collect, 
there  is  some  reason  to  favor  such  a  strategy — particularly  if  one 
suspects  that  the  effects  of  training  on  employment  may  be  unusually 
subtle  or  delayed  in  arriving.  This  strategy,  of  course,  depends  on 
the  measures  being  adequate  in  the  sense  of  being  replicable  so  that 
repeated  measurements  are  relatively  stable  and  in  their  being 


TABLE  A. 5  Social  and  Demographic  Characteristics  of  SAS  Samples 


Respondent 

Characteristic 

Sample 

Stage 

Entry 

% 

3 -Month 
Follow-up 
% 

8-Mor 

Folic 

% 

Female 

Participant 

51.9 

54.3 

54. 

Control 

51.1 

52.5 

53, 

High  school 

Participant 

25.5 

21.6 

20, 

dropout 

Control 

25.4 

24.5 

20, 

Income 

Participant 

66.3 

61.7 

63, 

70%  of  standard 

Control 

56.7 

56.4 

59, 

Welfare  recipient 

Participant 

42.7 

45.2 

47, 

Race/ethnicity 

Control 

38.6 

41.1 

42 

Black 

Participant 

56.2 

58.5 

58 

Control 

53.4 

55.2 

54 

Hispanic 

Participant 

21.9 

22.4 

23 

Control 

26.7 

29.2 

29. 

White 

Participant 

19.5 

16.8 

17, 

Control 

17.7 

14.3 

15. 

Limited  english 

Participant 

7.6 

8.1 

7. 

Control 

10.2 

9.4 

8. 

Has  children 

Participant 

11.3 

10.6 

11, 

Control 

8.5 

7.9 

8, 

Criminal  offender 

Participant 

8.2 

6.7 

7, 

Control 

11.5 

10.0 

12, 

Previous  CETA 

Participant 

30.0 

30.8 

30, 

participant 

Control 

25.5 

25.7 

25. 

NOTE:  Less  than  1  percent  of  data  records  were  inconsistent,  e.g.,  the 
respondent  was  a  "control"  but  the  3-month  follow-up  flag  indicated  the 
respondent  had  completed  a  "participant"  follow-up  survey.  These  recorc 
were  excluded  from  this  analysis. 

SOURCE:  Derived  by  tabulating  data  for  every  fifth  record  in  ETS  data 
base,  i.e.,  20  percent  subsample  of  data  base. 


reasonable  proxies  for  the  more  difficult  to  observe  outcomes.  The 
former  condition  is  generally  referred  to  under  the  rubric  of 
reliability,  the  latter  as  validity  (of  one  sort  or  another)  . 

Since  the  Standardized  Assessment  System  was  launched  with  some 
expressed  trepidations  about  the  suitability  of  such  measures  to  the 
YEDPA  population,  it  is  important  to  seek  evidence  within  the  data  b 
as  to  whether  these  conditions  are  met  by  the  SAS  measurements.  SAS 
provides  the  opportunity  for  making  (test-retest)  reliability  estima 


TABLE  A. 6  Job  Knowledge  and  Attitudes  and  Other  Pretest  Scores 
(at  entry)  of  Respondents  Giving  Interviews  at  Entry  and  3  and  8  Months 
Postprogram 


SAS  Measurement 

Sample 

Stage 

Entry 

3 -Month 
Follow-up 

8-Month 

Follow-up 

Standard 

Deviation 

of 

Scale 

Vocational  attitudes 

Participant 

20.5 

20.5 

20.4 

Control 

20.2 

20.2 

20.6 

4.5 

Job  knowledge 

Participant 

21.6 

21.8 

21.6 

Control 

21.4 

21.3 

21.7 

4.2 

Job  holding  skills 

Participant 

30.4 

30.6 

30.5 

Control 

30.2 

30.2 

30.3 

2.7 

Work-related 

Participant 

40.8 

48.2 

48.1 

attitudes 

Control 

47.9 

47.8 

48.5 

6.8 

Job  search  skills 

Participant 

11.7 

11.8 

11.7 

Control 

11.5 

11.3 

11.7 

3.2 

Sex  stereotyping 

Participant 

45.4 

45.1 

45.3 

Control 

45.0 

44.6 

45.0 

8.2 

Self-esteem 

Participant 

36.3 

36.4 

36.3 

Control 

35.9 

35.9 

36.2 

3.2 

Reading  ability 

Participant 

15.0 

15.0 

15.1 

(STEP) 

Control 

14.5 

14.6 

14.9 

4.6 

NOTE:  Standard  deviation  of  scale  is 

computed 

from  data  for 

all  controls  and 

participants. 

SOURCE:  Derived  by 

tabulating  data  for  every 

fifth  record  in  ETS  data 

base,  i.e., 

20  percent  subsample 

• 

for  these  scales, 

since  the  same 

battery 

was  administered  preprogram 

and  postprogram  to  the  untreated 

controls .  Although 

one  can  expect 

true  temporal  change  to  affect  the  cross- 

■temporal  correlations 

between 

two  measures  of  a  trait  such  as  self-esteem  or  work-related  attitudes, 
one  would  expect  a  certain  amount  of  stability  in  these  traits.  After 
all,  if  people  varied  widely  from  day  to  day  on  these  traits  it  is  not 
(easily)  conceivable  that  the  measure  would  be  helpful  in  predicting 
relatively  stable  social  behaviors,  such  as  employment  or  other 
vocational  behaviors. 

A  series  of  analyses  reported  in  Tables  A. 7  through  A.  10  examine 
some  of  the  properties  of  these  scales.  In  Table  A. 7,  the  zero-order 
correlation  of  each  scale  measured  preprogram  and  postprogram  is 


TABLE  A. 7  Test-Retest  Reliability  for  SAS  Measurements  (computed 
20  percent  sample  of  ETS  data  base) 


Zero-Order 

Correlation  Over  Tin 

SAS  Measurement 

Controls 

Participants 

Vocational  attitudes 

.604 

.602 

Job  knowledge 

.527 

.505 

Job  holding  skills 

.460 

.386 

Work-related  attitudes 

.604 

.610 

Job  search  skills 

.572 

.538 

Sex  stereotyping 

.631 

.643 

Self-esteem 

.462 

.388 

(N)b 

(1,644) 

(4,443) 

NOTES:  Test-retest  reliability  will  be  affected  by  "true  change" 

respondents.  Since  participants  are  enrolled 

in  programs  designee 

change  their  attitudes  and  knowledge,  reliability  estimates  for  th 

group  should  be  treated  with  caution. 

Measurements  made  using 

identical  instruments 

;  preprogram  and 

postprogram. 

Minimum  sizes  of  samples 

from  which  estimate 

was  made. 

TABLE  A. 8  Correlations  Between  Reading  Scores  and  SAS 
Job  Attitudes  and  Knowledge  (computed  from  20  percent 
base) 

i  Measurement 
sample  of  E!] 

Correlation  with 

STEP  Readinc 

SAS  Measurement3 

Participant 

Contro] 

Vocational  attitudes 

.445 

.509 

Job  knowledge 

.447 

.467 

Job  holding  skill 

.288 

.354 

Work-related  attitudes 

.446 

.383 

Job  search  skill 

.569 

.578 

Sex  stereotyping 

.279 

.241 

(N)b 

(5,603) 

(2,258] 

aAll  measurements  made  during  pretest. 

k  Maximum  sizes  of  samples  upon  which  any  reported  correlation  is 
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TABLE  A.  10  Estimates  of  Predictive  Validity  of  SAS  Attitude  and 
Knowledge  Measurements  (computed  from  20  percent  sample  of  ETS  data 
base) 


SAS  Measurement  at 
Program  Completion 

Sex 

Correlation  with 
3  Months 
Postprogram 

Activity  Status 
8  Months 
Postprogram 

Vocational  attitudes 

Male 

(.048) 

(.056) 

Female 

.078 

(.042) 

Job  knowledge 

Male 

.085 

(.042) 

Female 

.057 

(.042) 

Job  holding  skills 

Male 

.111 

.07  5 

Female 

(.043) 

(.031) 

Job  seeking  skills 

Male 

.097 

(.042) 

Female 

.060 

.055 

Work-related  attitudes 

Male 

.068 

(.057) 

Female 

.107 

.082 

Self-esteem 

Male 

.060 

(-.003) 

Female 

.092 

(.043) 

Sex  stereotyping 

Male 

-.054 

(-.029) 

Female 

.050 

(.013) 

N 

Male 

1,080 

714 

Female 

1,326 

935 

NOTE:  Estimated  coefficients  in  parentheses  are  not  reliably  differen 
from  0  (at  p  <  .05).  Correlations  are  derived  from  20  percent  subsamp 
of  YEDPA  participants  in  ETS  data  base.  Respondents  were  included  onl 
they  were  coded  as  a  participant  in  IPP  profile  and  if  the  data  flag  f 
the  3-month  follow-up  indicated  they  had  completed  a  participant  folic 
survey  (not  a  control  survey)  .  In  a  small  number  of  cases  (281  of 
50,182),  those  two  indicators  are  inconsistent;  those  cases  were  exclu 
from  this  analysis. 

aActivity  status  is  coded  1  if  respondent  is  in  a  full-time  job  or  is 
full-time  student;  status  is  coded  0  otherwise. 

reported  for  program  participants  and  controls.6  All  of  the 
test-retest  correlations  are  within  the  range  of  approximately  0.4  ■ 
0.6.  While  these  correlations  are  not  insubstantial,  neither  would 


6Obviously,  the  reliability  estimates  for  the  control  groups  are  mo 
relevant  since  the  controls  did  not  participate  in  YEDPA5 s  programs 
that  were  designed  to  change  participant’s  attitudes,  knowledge, 
behavior,  and  so  forth.  However,  as  Table  A. 7  shows,  reliability 
estimates  for  program  participants  are  quite  similar  to  those  for 
controls. 


they  be  thought  to  indicate  an  extremely  robust  measurement.  Indeed/ 
if  one  were  to  assume  that  measurement  errors  (both  random  and 
systematic)  did  not  contaminate  these  data,  these  estimates  would 
suggest  a  great  deal  of  variation  over  time  in  young  people’s  knowledge 
of  and  attitudes  toward  jobs,  their  self-esteem,  and  the  extent  to 
which  they  sex  stereotype  the  occupational  world.  This  could,  of 
course,  be  the  case.  But  it  is  also  plausible  that  a  relatively  large 
component  of  measurement  error  may  be  distorting  the  measurements. 

Overall,  the  self-esteem  scale  and  the  job-holding  skill  scale  show 
relatively  low  cross-temporal  correlations,  while  the  sex  stereotyping 
and  vocational  attitudes  scales  show  correlations  of  0.6  or  better. 

(In  the  case  of  the  sex  stereotyping  scale,  one  suspects  that  this 
relatively  high  estimate  of  reliability  may  derive,  in  part,  from  the 
fact  that  all  items  were  presented  in  the  same  format  and  scored  in  the 
same  direction.)  These  scales  also  show  a  high  correlation  with 
reading  ability.  Table  A. 8  presents  the  correlations  between  each  of 
these  scales  (measured  at  pretest)  and  the  STEP  reading  scale  scores. 
These  correlations  range  from  a  low  of  .241  for  sex  stereotyping  to  a 
high  of  .578  for  the  job  search  skill  scale. 

While  one  might  be  tempted  to  dismiss  some  of  these  high  correla¬ 
tions  with  reading  ability  as  "artifacts,"  for  some  purposes  the 
correlation  is  as  one  would  want.  The  ability  to  read  a  job  adver¬ 
tisement  is  an  essential  component  of  "job  search  skills."  It  is  not, 
however,  the  case  that  such  a  simple  argument  can  be  made  to  defend 
these  correlations  in  every  instance.  There  is  no  prima  facie  case  to 
be  made  for  a  correlation  between  the  attitude  measures  and  reading — 
although  there  are  more  than  enough  plausible  paths  for  indirect 
causation  to  account  for  this  correlation.  It  is  important  to  keep  in 
mind  that  reading  (and  a  myriad  of  other  unmeasured  traits)  may  play  a 
role  in  accounting  for  the  zero-order  test-retest  reliabilities. 
Potential  correlated  measurement  errors  also  bedevil  all  attempts  to 
understand  test-retest  reliabilities. 

Some  evidence  of  the  construct  validity  of  the  various  SAS 
measurements  may  be  gleaned  from  Table  A. 9.  As  intended  by  the  SAS 
designers,  all  of  the  measures  are  positively  intercorrelated.  This  is 
true  even  when  a  simplistic  attempt  is  made  to  account  for  confounding 
effects  of  reading  ability  on  all  of  the  scales.  The  strongest 
correlations  found  for  the  SAS  measures  are  between  scales  that  measure 


It  should  be  realized  that  test-retest  correlations  such  as  those 
shown  in  Table  A.  7  are  affected  by  both  true  change  in  the  respondents 
and  by  measurement  errors.  If  one  wishes  to  use  measures  like  the  SAS 
assessment  battery  as  proxies  for  (unmeasurable)  long-term  outcomes 
(e.g.,  lifetime  earning  potential  and  employability),  however, 
instability,  per  se,  may  be  an  important  consideration.  If  a 
characteristic  like  work-related  attitudes,  for  example,  naturally 
varies  to  such  a  degree  that  test-retest  correlations  approach  zero 
over  a  short  period  of  time  (in  the  absence  of  measurement  error)  ,  then 
even  a  perfectly  reliable  measurement  of  this  characteristic  would  be 
of  doubtful  utility  in  most  program  evaluations. 
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similar  or  related  traits,  e.g.,  vocational  attitudes  and  work-relate 
attitudes,  or  job  search  skills  and  job  knowledge.  Conversely,  corre 
tions  between  the  sex  role  stereotyping  measures  and  job  knowledge 
factors  are  low. 


Predictive  Validity 

Given  the  aim  of  the  YEDPA  programs,  a  key  validity  test  for  any 
scale  would  be  its  ability  to  predict  which  YEDPA  youth  would  stay  ir 
school  or  find  full-time  employment  and  which  would  not.  Several 
skirmishes  have  been  made  with  this  analysis  and  Table  A.  10  reports  \ 
simplest  of  them.  (Its  outcome,  however,  is  little  different  from  ti 
more  complicated  analyses.) 

For  all  program  participants  (in  20  percent  sample)  who  provided 
the  requisite  data  at  3  months  (n  =  2,406)  and  at  8  months  (n  =  1,64S 
postprogram,  a  score  of  1  was  assigned  if  (at  follow-up)  the  respond* 
reported  being  either  in  school  full  time  or  working  full  time.  A 
score  of  0  was  assigned  otherwise.  In  the  crudest  analysis  (reporte< 
in  Table  A. 10)  the  0-order  correlation  between  this  dichotomous 
"activity  variable"  and  each  of  the  scales  from  the  SAS  battery  was 
calculated.7  This  was  done  separately  for  males  and  females  to  allov 
the  effects  of  potential  differences  in  child-care  responsibilities  1 
appear . 

It  will  be  seen  from  Table  A. 10,  that  there  were  some  "significai 
correlations  between  job  knowledge  and  attitude  scores  and  whether  a 
youth  was  "occupied"  or  "unoccupied,"  however,  the  magnitude  of  thes< 
correlations  was  not  substantial.  The  correlations  for  the  SAS  data 
base  are  considerably  below  those  found  for  the  NYC  and  OIC  samples 
reported  by  ETS  in  their  1980  report  on  SAS  (Educational  Testing 
Service,  1980).  They  are  even  lower  than  the  correlations  (.10) 
reported  by  ETS  from  the  Youth  Career  Development  sample. 

The  extremely  low  predictive  validity  of  the  SAS  measures  raises 
questions  about  the  meaningfulness  of  program  evaluations  that  rest 
their  verdicts  of  program  effectiveness  on  such  measurements.  As 
Chapters  4  through  8  have  shown,  such  studies  are  are  not  uncommon  ii 
the  YEDPA  literature. 


Inter-site  Variations 

The  shortcomings  of  the  aggregate  SAS  data  base  invite  the 
questions  Is  the  data  base  uniformly  riddled  with  such  problems?  I 


7 This  analysis  is  somewhat  crude,  but  it  illustrates  the  point  in  a 
straightforward  manner  (and  it  is  analogous  to  analyses  reported  in 
ETS,  1980).  It  should  be  noted,  however,  that  because  the  criterion 
variable  is  dichotomous,  the  obtained  correlations  will  understate 
somewhat  the  extent  of  the  relationship. 


TABLE  A.  11  Follow-up  Rates  for  10  Randomly  Selected  Sites  in  SAS  Data 
Base 


Postprogram 
Follow-up  Stage3 

Sample 

Follow- 

0-24% 

■up  Rates 

25-49% 

50-74% 

75+% 

No 

Sample k 

3  months 

Participants 

1 

3 

2 

4 

„ 

Controls 

1 

3 

1 

2 

3 

8  months 

Participants 

5 

2 

2 

1 

— 

Controls 

4 

2 

1 

0 

3 

NOTE:  Ten  sites  were  selected  using  a  random  number  table  from  among  all  sites  in 
the  ETS  data  base  having  an  "n"  of  at  least  25  (controls  +  participants)  at  Wave 
1.  N's  for  samples  whose  rates  are  shown  above  range  from  24  to  167. 

3Follow-up  rate  is  a  percentage  of  all  respondents  at  site  for  whom  there  is  any 
3-month  (or  8-month)  interview  data  (as  indicated  by  "flags"  set  in  the  data  base 
to  indicate  presence  or  absence  of  these  data)  . 

^Three  sites  had  no  control  groups. 


is  possible  in  theory,  of  course,  for  an  aggregate  outcome  such  as  the 
one  reported  here  to  be  composed  of  some  very  fine  data  gathering 
operations  and  some  very  poor  ones.  While  the  aggregate  result  would 
not  be  impressive,  it  still  might  be  possible  to  isolate  a  sizable 
subset  of  the  data  base  upon  which  a  convincing  analysis  could  be 
performed. 

To  assay  this  possibility,  we  selected  10  sites  at  random  from  the 
SAS  data  base  and  ascertained  the  distribution  of  attrition  rates 
across  sites.  We  restricted  the  universe  of  potential  sites  for  this 
analysis  to  sites  that  had  a  minimum  of  25  respondents  (controls  and 
participants)  at  the  initial  data  collection.  For  each  of  these  sites, 
we  then  computed  the  follow-up  rates  at  3  and  8  months  postprogram. 

The  distribution  of  follow-up  rates  across  the  10  sites  is  shown  in 
Table  A.  11.  It  will  be  seen  that  at  3  months  postprogram  four  sites 
had  follow-up  rates  for  participants  of  75  percent  or  higher.  For  the 
control  samples,  only  two  sites  had  such  high  follow-up  rates. 

While  the  attrition  analysis  at  3  months  is  somewhat  encouraging, 
the  results  at  8  months  are  quite  disappointing.  Only  one  site 
maintained  a  75  percent  follow-up  rate  for  participants  at  8  months, 
and  no  site  attained  this  rate  for  its  control  samples. 

In  addition  to  the  analysis  of  attrition  rates,  we  also  attempted 
to  assay  the  distribution  across  sites  of  the  predictive  validity  of 
the  SAS  attitude  and  knowledge  measurements.  Here  again,  we  selected 
10  sites  at  random  from  the  SAS  data  base.  This  time,  however,  we 
restricted  our  analysis  to  sites  that  had  a  minimum  of  100  program 
participants  from  whom  data  had  been  obtained  at  3  months  postprogram. 
This  was  done  to  provide  an  adequate  sample  size  for  calculating  the 
correlation  coefficients  between  the  (immediate)  postprogram  SAS 
measurements  and  the  participants'  "activity  status"  at  3  months 
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postprogram.  Table  A. 12  presents  the  results  of  this  analysis.  (See 
the  notes  to  Table  A. 12  for  definitions  of  sample  selection  criteria 
and  the  activity  status  variable.) 

It  will  be  seen  from  Table  A.  12  that  no  predictive  validity  for  any 
measurement  at  any  site  exceeded  0.30.  The  vast  majority  of 
correlations  (48  of  the  60  that  could  be  calculated)  were  in  the  range 
0.0  to  0.20.  Indeed,  over  half  of  the  coefficients  we  calculated  (36 
of  60)  were  less  than  0.10. 

While  it  would  be  a  mistake  to  overgeneralize  based  on  data  from 
such  a  small  number  of  sites,  these  data  on  attrition  and  measurement 
validity  do  not  encourage  the  belief  that  there  exist  a  sizable  number 
of  sites  in  the  SAS  data  base  that  gathered  high-quality  data  (where 
quality  is  indicated  by  the  attrition  of  the  sample  and  the  predictive 
validity  of  the  measurements) . 
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Report  List 


This  appendix  lists  the  reports  considered  by  the  committe 
assessment  of  program  effectiveness  and  program  implementation 
the  Youth  Employment  and  Demonstration  Projects  Act  (YEDPA) * 
Chapter  4  for  a  description  of  the  procedures  and  criteria  use 
selection  of  reports  included  in  review  of  YEDPA  programs.)  T 
section  lists  research  reports  on  the  effectiveness  of  individ 
projects.  The  second  section  lists  reports  on  the  implementat 
YEDPA  programs  in  general. 

For  the  review  of  program  effectiveness  only  those  project 
listed  in  the  first  section  were  considered.  All  of  these  rep 
the  committee's  initial  criteria  for  the  effectiveness  review, 
more  thorough  examination  many  of  these  project  reports  were  e 
from  the  effectiveness  review  because  they  did  not  meet  the  se 
stage  criteria  of  scientific  evidence  set  by  the  committee.  P 
reports  that  did  meet  committee  standards  and  were  included  in 
review  of  program  effectiveness  (Chapters  5-8)  are  indicated  b 
in  the  left  margin. 

For  the  review  of  program  implementation  the  committee  con 
two  types  of  reports:  project  reports  (listed  in  the  first  se 
that  also  contained  information  pertinent  to  program  implement 
and  reports  on  program  implementation  and  operation  that  were 
candidates  for  the  effectiveness  review  because  they  were  not 
to  individual  projects  and  because  they  lacked  effectiveness  d 
Project  reports  of  the  first  type  included  in  the  implementati 
(Chapter  3)  are  indicated  by  an  "I"  in  the  left  margin.  Repor 
second  type  are  listed  in  the  second  section,  Implementation  B 
All  of  these  reports  are  included  in  the  implementation  review 

Reports  are  listed  alphabetically  by  authoring  organizatic 
Reports  were  prepared  for  the  funding  agency,  the  Employment  a 
Training  Administration  of  the  U.S.  Department  of  Labor,  unles 
otherwise  indicated.  Many  of  the  projects  included  here,  for 
were  designed  and  managed  by  the  Manpower  Demonstration  Resear 
Corporation  (MDRC)  with  the  evaluation  subcontracted  to  Abt  As 
or  Mathematica  Policy  Research.  These  project  reports  are  lis 
respectively  under  Abt  Associates  or  Mathematica  Policy  Resear 
an  indication  that  they  were  prepared  for  MDRC. 
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Abt  Associates,  Inc.,  Boston 
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Abt  Associates,  Inc.,  and  Randall  J.  Olsen,  Yale  University, 
for  MDRC. 
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D.A.  Smith,  E.W.  Stromsdorfer,  and  C.  Bottom,  Abt  Associates, 
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Stromsdorfer,  G.  Trask,  and  R.  Jerrett  III,  Abt  Associates, 
Inc.,  for  MDRC. 

E  1983  Final  Program  Impacts  of  the  Youth  Incentive  Entitlement 
Pilot  Projects.  Prepared  by  G.  Farkas,  R.  Olsen,  E.W. 
Stromsdorfer,  L.C.  Sharp,  F.  Skidmore,  D.A.  Smith,  and  S. 
Merrill  for  MDRC. 

ACTION/Off ice  of  Voluntary  Citizen  Participation,  Washington,  D.C. 

1981  Executive  Summary  to  Final  Report;  Youth  Employment  Support 
Program. 

1981  Final  Report;  Youth  Employment  Support  Program  (YES) . 

A.L.  Nellum  and  Associates,  Washington,  D.C. 

E  1980  Impacts  of  SYEP  Participation  on  Work-Related  Behavior  and 
Attitudes  of  Disadvantaged  Youth;  Final  Report. 

Athletes  for  Better  Education,  Chicago 

1982  Athletes  for  Better  Education;  Academic-Athletic-Counseling 
Project . 

American  Association  of  Community  and  Junior  Colleges  Washington,  D.C. 
n.d.  The  AACJC  Education-Work  Council  Program;  Second  Year 
Report.  Summary  and  Analysis. 

1979  Community  Education-Work  Councils;  The  AACJC  Project. 

Second  Year  Report. 

American  Camping  Association,  Port  Deposit,  Md . 

1981  Project  STAFF.  Final  Report. 

American  Institutes  for  Research  in  the  Behavioral  Sciences, 

Washington,  D.C. 

E  1982  Needs  and  Characteristics  of  Pregnant  and  Parenting  Teens; 

The  Baseline  Report  for  Project  Redirection.  Prepared  by 
D.F.  Polit,  with  J.R.  Kahn,  C.A.  Murray,  and  K.W.  Smith  for 
MDRC. 


E  1983  School,  Work  and  Family  Planning;  Interim  Impacts  in  Project 
Redirection.  Prepared  by  D.F.  Polit,  M.B .  Tannen,  and  J.R. 
Kahn  for  MDRC. 

Center  for  Employment  and  Income  Studies,  The  Florence  Heller  Graduate 
School  for  Advanced  Studies  in  Social  Welfare,  Brandeis  University 
E  1981  The  Effectiveness  of  Two  Job  Search  Assistance  Programs  for 
Disadvantaged  Youth.  Final  Report.  Prepared  by  A.  Hahn  and 
B.  Friedman,  with  C.  Rivera  and  R.  Evans. 


E  1982  Can  Employer  or  Worker  Subsidies  Raise  Youth  Employment?  ; 
Evaluation  of  Two  Financial  Incentive  Programs  for 
Disadvantaged  Youth.  Final  Report.  Prepared  by  C. 

River a-Casale,  B.  Friedman,  and  R.  Lerman. 

Center  for  Labor  and  Human  Resource  Studies,  Temple  University 
E  1981  Program  Impacts  of  Jobs  for  Delaware's  Graduates,  Inc, 

Technical  Report.  Post-Program  Experiences  of  1980  Delawa 
High  School  Seniors  Participating  in  the  First  Year  of  a 
School-to-Work  Transition  Program.  Prepared  by  M.F.  Eleey 
and  R.D.  Leone,  with  V.  Singh. 

E  1982  An  Evaluation  of  the  Program  Effects  of  Jobs  for  Delaware 
Graduates,  Inc.  Post  High  School  Labor  Market  Experiences 
1980  and  1981  Delaware  High  School  Graduates  Participating 
a  Special  School-to-Work  Transition  Program.  Prepared  by 
M.F.  Eleey  and  R.D.  Leone,  with  K.M.  Whitehouse  and  V.  Sin< 
E  1983  An  Evaluation  of  the  Program  Effects  of  Project  BEST. 

Educational  Attainment  and  Post  High  School  Labor  Market 
Experiences  of  1980  and  1981  High  School  Seniors  after 
Participation  in  a  Labor  Market  Information  Pilot  Program. 
Prepared  by  R.D.  Leone  and  M.F.  Eleey. 

Center  for  Studies  in  Social  Policy,  McLean,  Va. 

E  1981  Evaluation  of  the  OIC/A  Career  Exploration  Project — 1980. 

Final  Report.  Prepared  by  J.M.  O'Malley,  B.  Bednarz  Hampsi 
D.H.  Holmes,  A.M.  Ellis,  and  F.J.  Fannan,  for  Opportunitie 
Industrialization  Centers  of  America,  Inc. 

Center  for  Urban  Programs,  St.  Louis  University 

1979  1978  Vocational  Exploration  Program.  The  Final  Report. 

Vocational  Exploration  Demonstration  Project:  Operations 
Guidelines. 


1979 


E  1980 


1980 


A 

Prepared 


1981 


An 

Prepare 


1981 


1981 


E  1981 


1982 


Public  Versus  Private  Sector  Jobs  Demonstration  Project; 
Analysis  of  In-Program  Effects  and  Outcomes. 

The  Vocational  Exploration  Demonstration  Project: 
Preliminary  Analysis  of  the  1979  Fall  Component. 

B.P .  Nedwek ,  J.  Terence  Manns,  and  E.A.  Tomey. 

The  Vocational  Exploration  Demonstration  Project; 
Analysis  of  the  1979-80  Academic  Year  Components, 
by  B.P.  Nedwek,  J.  Terence  Manns,  and  E.A.  Tomey. 

The  Vocational  Exploration  Demonstration  Project: 
Analysis  of  the  1980  Summer  Component.  Prepared  by  B.P. 
Nedwek,  J.  Terence  Manns,  and  E.A.  Tomey. 

The  Vocational  Exploration  Demonstration  Project;  An 
Analysis  of  the  1979-80  In-School  Extension  Components. 
Public  Versus  Private  Sector  Jobs  Demonstration  Project: 
Final  Report.  Prepared  by  J.F.  Gilsinan  and  E.A.  Tomey. 
Final  Report:  Part  A.  The  Vocational  Exploration 


An 


Demonstration  Project: 
of  VEDP  II. 


An  Analysis  of  the  Long  Term  Impac 


1982  The  Vocational  Exploration  Demonstration  Project:  An 

Analysis  of  the  Eight  Month  Follow-up  of  Year  One.  Prepar 
by  B.P.  Nedwek,  J.  Terence  Manns,  and  E.A.  Tomey. 


1982  The  Vocational  Exploration  Demonstration  Project;  A 

Preliminary  Analysis  of  VEDP  II  and  Its  Policy  Implications, 
City  University  of  New  York 

E  1981  The  Youth  Incentive  Entitlement  Pilot  Projects 

Demonstration;  How  Youths  View  the  Program ,  An  Attitudinal 
Study.  Prepared  by  B.  Joans,  John  Jay  College  of  Criminal 
Justice,  for  MDRC. 

I  1981  Final  Evaluation  Report  on  Oswego  Youth  Community  Service. 

Prepared  by  M.  Gittell,  with  M.  Beardsley  and  M.  Weissman. 

I  1981  Final  Evaluation  Report  on  Syracuse  Youth  Community  Service. 
Prepared  by  M.  Gittell,  with  M.  Beardsley  and  M.  Weissman. 
Clark,  Phipps,  Clark  &  Harris,  Inc.,  New  York 

1979  Career  Advancement  Voucher  Demonstration  Project.  Final 
Guidelines. 

1980  Career  Advancement  Voucher  Demonstration  Project.  The  First 
Academic  Year. 

1981  Career  Advancement  Voucher  Demonstration  Project.  Second 
Year  Final  Report. 

CSR,  Inc.,  Washington,  D.C. 

E  1981  Report  on  Impacts;  Study  of  New  Youth  Initiatives  In 

Apprenticeship.  Prepared  by  G.D.  Williams,  E.P.  Davin,  B. 
Barrett,  and  J.M.  Richards,  Jr. 

E  1981  Draft  Phase  II  Report;  Study  of  New  Youth  Initiatives  in  . 
Apprenticeship. 

E  1981  Study  of  New  Youth  Initiatives  in  Apprenticeship. 

Dynamic  Programs,  Inc.,  Trenton,  N.J. 

1  1982  Career  Exploration  Program — Comparative  Analyses,  Program 
Participants  and  Matched  Controls.  Prepared  by  L.  Mehl. 
Educational  Testing  Service,  Princeton,  N.J. 

E  1980  Assessment  of  the  Youth  Career  Development  Program  for 
School- to-Work  Transition;  A  Phase  I  Evaluation- 
Demonstration  Study.  Technical  Report  no.  2.  Prepared  by 
D.A.  Rock  and  N.E.  Freeberg. 

E  1981  Eight  Month  Follow-up  Evaluation  of  the  Youth  Career 

Development  Program  for  School- to-Work  Transition.  An 
Addendum  to  ETS  Technical  Report  no.  2.  Prepared  by  D.A. 
Rock  and  N.E.  Freeberg. 

E  1981  Assessment  of  the  U.S.  Employment  Service  Project  STEADY. 
Technical  Report  no.  9.  Prepared  by  J.  Grandy. 

1981  Assessment  of  the  National  Football  League  Players 

Association  Vocational  Exploration  Program  (Unions  for 
Youth) ,  Summer  1979.  Technical  Report  no.  4.  Prepared  by 

D. A.  Trismen. 

1981  Assessment  of  the  National  Football  League  Players 

Association  Vocational  Exploration  Program  (Unions  for 
Youth) ,  Summer  1980.  Technical  Report  no.  17.  Prepared  by 

E. C .  Driscoll. 

Assessment  of  the  SER  Career  Exploration  Program,  Summer 
1979.  Technical  Report  no.  5.  Prepared  by  D.A.  Trismen. 


E  1981 


E  1981 

E  1981 

1981 

E  1981 

1981 

1981 

E  1981 

I  1982 

1982 
1982 

E  1982 

1982 

E  1982 

1982 

1982 

1982 


Evaluation  of  A  Service  Mix  Alternatives  Demonstration 
Program  For  Out-of-School  Youth.  Technical  Report  no.  7. 
Prepared  by  N.E.  Freeberg  and  D.A.  Rock. 

Assessment  of  the  Bureau  of  Apprenticeship  and  Training  (BA 
School/Work  Linkage  Projects.  Technical  Report  no.  8. 
Prepared  by  J.  Grandy. 

Assessment  of  the  Graphic  Communications  Training  Program 
Giant  Step.  Technical  Report  no.  10.  Prepared  by  R.T. 
Murphy  and  L.R.  Appel. 

Assessment  of  the  National  Puerto  Rican  Forum  School  to  Wor 
Program  NPRD-STWP .  Year  1.  Technical  Report  no.  11. 
Prepared  by  R.T.  Murphy  and  L.R.  Appel. 

Assessment  of  the  Health  Opportunities/Positive  Entry 
Program — Project  HOPE.  Phase  I.  Technical  Report  no.  12. 
Prepared  by  R.T.  Murphy  and  L.R.  Appel. 

Assessment  of  the  National  Urban  League  Summer  Occupational 
Awareness  Program  1979.  Technical  Report  no.  6.  Prepared 
T.L.  Hilton. 

Assessment  of  the  SER  Career  Exploration  Program,  Summer 
1980 .  Technical  Report  no.  13.  Prepared  by  D.A.  Trismen  a 
E.C.  Driscoll. 

Assessment  of  the  Corporate  Career  Demonstration  Program. 
Technical  Report  no.  14.  Prepared  by  D.A.  Trismen. 
Assessment  of  the  Junior  Achievement  Adaptation  Demonstrati 
Program.  Technical  Report  no.  15.  Prepared  by  D.A.  Trisme 
Assessment  of  the  PUSH  For  Excellence,  Inc.  Career 
Exploration  Demonstration  Project.  Technical  Report  no.  16 
Prepared  by  T.L.  Hilton. 

Assessment  of  the  National  Puerto  Rican  Forum  Program 
1980-1981.  Technical  Report  no.  20.  Prepared  by  D.A. 
Trismen. 

Assessment  of  the  National  Urban  League  Summer  Occupational 
Awareness  Program  1980.  Technical  Report  no.  18.  Prepared 
by  T.L.  Hilton. 

Evaluation  of  the  Youth  Career  Development  Program  for 
School-to-Work  Transition,  Phase  II;  Replication  with  Juni 
and  Senior  High  School  Cohorts.  Technical  Report  no.  19. 
Prepared  by  N.E.  Freeberg  and  D.A.  Rock. 

Assessment  of  the  Green  Thumb  Youth  Demonstration  Program. 
Technical  Report  no.  21.  Prepared  by  D.A.  Trismen. 
Assessment  of  Six  Youth  Employment  Programs;  Rural  Youth  c 
Housing  Partnership,  Youth  Agricultural  Entrepreneurship, 
Economic  Development  through  Community  Improvement ,  Jobs  fc 
Youth ,  Second  Chance,  Assembly  Youth  Employment  (National 
Association  for  Southern  Poor).  Technical  Report  no.  22. 
Prepared  by  D.A.  Trismen. 

The  Social  Demography  of  Participants  and  Controls  in  YoutE 
Employment  and  Demonstration  Projects  Act  (YEDPA)  Programs; 
Information  Derived  from  the  Standard  Assessment  System  Pat 
Base.  Final  Data  Base  Report  no.  1.  Technical  Report  no. 
23.  Prepared  by  L.F.  Cole,  J.M.  Goodison,  and  D.A.  Rock. 


1982  Demonstration  Programs  for  Youth  Employment  Trainings  The 
Evaluation  of  Various  Categories  of  YEDPA  Program  Sites. 

Final  Data  Base  Report  no.  2.  Technical  Report  no.  24. 
Prepared  by  D.A.  Rock,  N.E.  Freeberg,  D.A.  Trismen,  and  J.M. 
Good i son . 

1982  The  Relationship  between  Program  Processes  and  Employment 
Outcomes  for  YEDPA  Youth.  Final  Data  Base  Report  no.  3. 
Technical  Report  no.  25.  Prepared  by  D.A.  Rock,  N.E. 
Freeberg,  J.M.  Goodison,  and  J.  Pollack. 

Graduate  School  for  Community  Development,  San  Diego 

1981  Second  Year  and  Final  Report;  Junior  Achievement  Adaptation 
Demonstration  Project. 

Greenleigh  Associates 

^981  Evaluation  of  HRDI-SYEP  Program;  1980  Final  Report. 

Institute  for  Economic  Development,  Washington,  D.C. 

n.d.  Electronic  Industries  Foundation  JET  Program.  Final  Report. 
Prepared  by  V.C.  Knorr  and  S.L.  Patton. 

James  H.  Lowry  and  Associates,  Chicago,  Ill.,  and  Washington,  D.C. 

1980  Research  and  Evaluation  of  the  A.  Philip  Randolph  Educational 
Fund  Youth  Employment  Program;  An  Analysis  of  Factors 
Related  to  Participants  Leaving  School. 

1980  Research  and  Evaluation  of  the  A.  Philip  Randolph  Educational 
Fund  Youth  Employment  Program;  An  Analysis  of  Factors 
Related  to  Employment  of  YEP  Participants. 

Jobs  for  America's  Graduates,  Washington,  D.C. 

E  1983  Initial  Employment  and  Earnings  Impacts  of  JAG  Programs 

Operating  During  the  1981-2  School  Year.  Prepared  by  A.  Sum. 
Manpower  Demonstration  Research  Corporation  (MDRC) ,  New  York 

E  1979  The  Youth  Entitlement  Demonstration  Program:  A  Summary 
Report  on  the  Start-Up  Period  of  The  Youth  Incentive 
Entitlement  Pilot  Projects  January- June,  1978. 

E  1979  The  Youth  Entitlement  Demonstration;  An  Interim  Report  on 
Program  Implementation.  Prepared  by  J.  Ball,  W.  Diaz,  J. 
Leiman,  S.  Mandel,  and  K.  McNutt. 

E  1979  A  Preliminary  Estimate  of  the  Impact  of  Youth  Entitlement  on 
School  Behavior .  Prepared  by  S.  Mandel  and  L.  Solnick. 

E  1980  The  Youth  Entitlement  Demonstration:  Second  Interim  Report 
on  Program  Implementation.  Prepared  by  W.  Diaz,  J.  Ball,  N. 
Jacobs,  L.  Solnick,  and  A.  Widman. 

E  1981  The  Participation  of  Private  Businesses  as  Work  Sponsors  in 

the  Youth  Entitlement  Demonstration.  Prepared  by  J.  Ball  and 
C.  Wolfhagen,  with  D.  Gerould  and  L.  Solnick. 

E  1981  Project  Redirection;  Interim  Report  on  Program 

Implementation.  Prepared  by  A.  Branch  and  J.  Quint,  with  S. 
Mandel  and  S.  Shuping  Russell. 

E  1981  The  Supported  Work  Youth  Variation:  An  Enriched  Program  for 
Young  High  School  Drop-outs.  Prepared  by  V.  Semo  Scharfman. 

E  1982  Linking  School  and  Work  for  Disadvantaged  Youths:  The  YIEPP 
Demonstration:  Final  Implementation  Report.  Prepared  by 
W. A.  Diaz,  J.  Ball,  and  C.  Wolfhagen,  with  J.  Gueron,  S. 
Sheber,  and  A.  Widman. 
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E  1982  The  Enrichment  Program:  Strengthening  the  School-Work 

Linkage  in  the  Youth  Incentive  Entitlement  Pilot  Projects 
Prepared  by  R.  Ivry  and  C.  Wolfhagen,  MDRC,  and  C.E.  Van 
Horn,  Eagleton  Institute  of  Politics,  Rutgers  University. 

I  1982  Impacts  From  The  Youth  Incentive  Entitlement  Pilot  Projecl 
Participation  Work,  And  Schooling  Over  The  Full  Program 
Period.  Prepared  by  G.  Farkas,  D.A.  Smith,  E.W. 
Stromsdorfer ,  G.  Trask,  and  R.  Jerrett  III. 

E  1983  Choices  and  Life  Circumstances:  An  Ethnographic  Study  of 
Project  Redirection  Teens.  Prepared  by  S.  Brooks  Levy,  w: 
W.J.  Gr inker. 

E  1984  Post-Program  Impacts  of  the  Youth  Incentive  Entitlement  P 
Projects.  Prepared  by  G.  Farkas,  R.  Olsen,  E.W. 
Stromsdorfer,  L.C.  Sharpe,  F.  Skidmore,  D.A.  Smith,  and  S 
Merrill. 

I  1984  Post-Program  Impacts  of  The  Youth  Incentive  Entitlement  P: 
Projects .  Prepared  by  G.  Farkas,  R.  Olsen,  E.W. 
Stromsdorfer,  L.C.  Sharpe,  F.  Skidmore,  D.A.  Smith,  and  S 
Merrill . 

1  1985  Final  Impacts  From  Project  Redirection;  A  Program  For 

Pregnant  And  Parenting  Teens.  Prepared  by  D.  Polit,  J.  Ki 
and  D.  Stevens. 

Mark  Battle  Associates,  Inc.,  Washington,  D.C. 

n.d.  The  Mixed  Income  Experiment;  Statistical  Analysis  Report 
Prepared  for  Educational  Testing  Service. 

1979  Data  Collection  and  Analysis  Plan.  Assessment  of  the  Sta 
and  Results  of  Mixed  Income  Experiments. 

1979  Guidelines  and  Operational  Procedures  for  The  Mixed  Incom 
Experiment. 

1980  The  Mixed  Income  Experiment.  Report  I:  A  Description  of 
Program  Participants. 

I  1980  Appendix  1:  Preliminary  Case  Studies,  from  Report  I: 

Description  of  Program  Participants,  Mixed  Income  Experim 

1980  The  Mixed  Income  Experiment.  Report  II;  Midprogram  Prog: 
Report. 

I  1980  Revised  Final  Report  Phase  I:  Assessment  and  Status  of  M 
Income  Testing. 

1980  Technical  Work  Plan.  Follow-up  Survey  of  Participants  in 
Mixed  Income  Study. 

1981  Executive  Summary:  The  Mixed  Income  Experiment. 

1981  Mixed  Income  Experiment  Phase  III  Report  I:  Participant 
Status  Three  Months  after  Program  Completion. 

1981  Mixed  Income  Experiment  Phase  III  Report  II;  Participant 
Status  Eight  Months  after  Program  Completion. 

1981  The  Mixed  Income  Experiment.  Report  III:  Test  Results  b 
Site. 

1981  The  Mixed  Income  Experiment.  Report  IV:  Aggregate  Analy 

1981  The  Mixed  Income  Experiment.  Report  V;  Procedural  Conce 
in  the  Operation  of  the  Multi-Site  Study. 
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Marquette  University,  Educational  Opportunity  Program 

n .d.  Upward  Bound/CETA  Demonstration  Project;  A  Summary  Report  on 
First  Year  Findings.  Prepared  by  D.  Franklin,  M.K.  Kinnick, 
and  D.E.  Mackenzie. 

Mathematica  Policy  Research,  Inc.,  Princeton,  N.J. 

I  1977  Evaluation  of  the  Economic  Impact  of  the  Job  Corps  Program; 
Interim  Report  Volume  I.  Prepared  by  S.  Kerachsky  and  C. 
Mallar . 

E  1978  Evaluation  of  the  Economic  Impact  of  the  Job  Corps  Program. 

First  Follow-Up  Report.  Project  Report  78-14.  Prepared  by 
C.  Mallar,  S.  Kerachsky,  C.  Thornton,  D.  Long,  T.  Good,  and 
P.  Lapczynski. 

E  1980  The  Impact  of  Supported  Work  on  Young  School  Dropouts. 
Prepared  by  R.  Maynard  for  MDRC. 

I  1980  A  Study  of  Youth  Employment  Programs  and  Demonstrations  in 
Syracuse,  New  York.  Preliminary  Report.  Prepared  by  D. 
Zimmerman,  J.R.  Egan,  and  R.  Ross. 

E  1980  A  Study  of  the  Value  of  Output  of  Participants  in  the  Summer 
Youth  Employment  Program.  Final  Report  Preliminary  Draft. 
Prepared  by  D.  Zimmerman. 

E  1980  Evaluation  of  the  Economic  Impact  of  the  Job  Corps  Program. 
Second  Follow-Up  Report.  Prepared  by  C.  Mallar,  S. 

Kerachsky,  C.  Thornton,  M.  Donihue,  C.  Jones,  D.  Long,  E. 
Noggoh,  and  J.  Schore. 

I  1982  Post-Program  Impacts  of  Supported  Work  on  Young  School 

Dropouts:  Results  from  a  Follow-Up  Survey.  Prepared  by  R. 
Maynard,  E.  Gavin,  and  J.  Schore. 

E  1982  Post-Program  Impacts  of  Supported  Work  on  Young  School 

Dropouts:  Results  from  a  Follow-up  Survey.  Prepared  by  R. 
Maynard,  E.  Cavin,  and  J.  Schore. 

E  1982  Evaluation  of  the  Economic  Impact  of  the  Job  Corps  Program. 

Third  Follow-Up  Report.  Prepared  by  C.  Mallar,  S.  Kerachsky, 
C.  Thornton,  and  D.  Long. 

National  Puerto  Rican  Forum,  Inc.,  New  York 

E  n.d.  School-To-Work  Transition  Program  Annual  Report,  1980-1981. 
National  Urban  League,  Inc.,  New  York 

E  1980  Public  vs.  Private  Sector  Jobs  for  Youth  Demonstration 
Project.  Final  Report.  Prepared  by  J.  Parsons. 

Olympus  Research  Centers,  Salt  Lake  City 

E  1982  Evaluation  of  Job  Track:  A  Youth  Job  Search  Demonstration. 
Prepared  by  D.C.  Roberts. 

E  1982  Getting  Youth  on  the  Job  Track:  A  Description  and  Evaluation 
of  a  Job  Search  Training  Program.  Prepared  by  M.  Johnson, 
with  D.  Roberts. 

Proaction  Institute,  East  Lansing,  Mich. 

1982  Appendix  A:  The  French  Landing  Hydro  Project  Youth 

Employment  Hydropower  Redevelopment  Project.  Final  Report. 
Prepared  by  D.  Freddolino,  E.  Perri,  and  B.  Redman. 


Public/Private  Ventures,  Corporation  for,  Philadelphia 

E  1979  The  Development  of  the  Ventures  in  Community  Improvement 

Demonstration;  A  Review  and  Analysis  of  the  Process  Through 
Which  a  Demonstration  Project  Was  Mounted  under  the  Youth 
Employment  Demonstration  Projects  Act  of  1977.  Prepared  by 
H. D .  Shapiro  and  H.  Blakely. 

1980  New  Career  Pathways;  Initial  Research  Report.  Prepared  by 
H.R.  Arnold  and  G.  Rubinow. 

E  1980  The  Ventures  in  Community  Improvement  Program  (VICI) ;  A 
Demonstration  of  Program  Replication  through  the  CETA 
System.  Third  Interim  Research  Report. 

E  1982  Ventures  in  Community  Improvement.  Final  Report  of  the 
Demonstration.  Executive  Summary. 

E  1982  Ventures  in  Community  Improvement.  Final  Report  of  the 
Demonstration. 

1982  Final  Report  on  Public/Private  Ventures8  Youth 
Entrepreneurship  Initiative. 

E  1982  The  Impact  of  Pre-Employment  Services  on  the  Employment  and 
Earnings  of  Disadvantaged  Youth.  Final  Report. 

E  1983  Longer  Term  Impacts  of  Pre-Employment  Services  on  the 
Employment  and  Earnings  of  Disadvantaged  Youth. 

Resource  Consultants,  Inc.  (RCI) ,  McLean,  Va . 

E  ^981  Special  Project  for  Indochinese  Youth.  Final  Results. 
Prepared  by  D.  Gosselin  and  M.  Papageorgiou . 

RMC  Research  Corporation,  Mountain  View,  Calif. 

I  1979  Study  of  the  Career  Intern  Program;  Interim  Report — Task  A; 

Fidelity  of  Implementation.  Prepared  by  P.G.  Treadway,  C.M. 
Foat,  D.M.  Fetterman,  N.P.  Stromquist,  and  G.  Fasten 
Tallmadge  for  National  Institute  of  Education. 

I  1981  Study  of  the  Career  Intern  Program;  Summary  Report. 

Prepared  by  G.  Fasten  Tallmadge,  P.G.  Treadway,  and  D.M. 
Fetterman. 

I  1981  Study  of  Career  Intern  Program;  Final  Report-Task  B; 

Assessment  of  Intern  Outcomes.  Prepared  by  G.  Fasten 
Tallmadge  and  S.D.  Yuen. 

Recruitment  and  Training  Program  (R-T-P) ,  Inc.,  New  York 
E  1982  Career  Exploration  Program.  Final  Report. 

70001  Ltd.,  Washington,  D.C. 

E  1980  70001  Ltd.  Replication  Process  Internal  Evaluation.  Final 

Report.  Prepared  by  M.J.  Moor house. 

E  1983  70001  Ltd.  Final  Report  to  the  U.S.  Department  of  Labor. 

Team  Associates,  Inc.,  Washington,  D.C. 

E  1982  Job  Corps8  Educational  Improvement  Effort;  A  Comprehensive 
Analysis . 

E  1982  Job  Corps8  Educational  Improvement  Effort;  Phase  III  Final 
Report.  Prepared  by  B.J.  Argento,  F.  Flaherty,  D.M.  Geller, 
and  R.  Thurman. 

Texas  Association  of  Developing  Colleges,  Dallas 

I  1980  Evaluation  of  the  Opportunities  to  Learn  and  Earn  Project. 
Prepared  by  D.L.  Ford  and  Associates. 


229 


University  of  Houston 

I  1981  Corporate  Career  Demonstration  Project.  Executive  Summary. 
Prepared  by  D.A.  Sanders* 

I  1981  Corporate  Career  Demonstration  Project*  Final  Report. 

University  of  Tennessee 

1981  An  Evaluation  of  the  Summer  Science  Student  Programs  Cycle  I 
Results  for  the  San  Juan,  Mayaguez  and  Goodyear  Atomic 
Sites*  Prepared  by  K.  Rasmussen  Lounsbury,  M.S.  Weaver,  and 
J.W.  Lounsbury  for  Oak  Ridge  Associated  Universities,  Inc., 
and  U.S.  Department  of  Energy. 

1982  An  Evaluation  of  the  Summer  Science  Student  Program;  Cycle 
II  Results  for  the  San  Juan,  Mayaguez  and  Goodyear  Atomic 
Sites.  Prepared  by  K.  Rasmussen  Lounsbury,  M.S.  Weaver,  and 
J.W.  Lounsbury  for  Oak  Ridge  Associated  Universities,  Inc., 
and  U.S.  Department  of  Energy. 

Vera  Institute  of  Justice,  New  York 

E  1983  Alternative  Youth  Employment  Strategies  Project:  An 

Evaluation.  Special  Summary.  Prepared  by  S.  Sadd,  M. 

Kotkin,  and  S.R.  Friedman. 

E  1983  Alternative  Youth  Employment  Strategies  Project:  Final 

Report.  Prepared  by  S.  Sadd,  M.  Kotkin,  and  S.R.  Friedman. 

Washington  State  Building  &  Construction  Trades  Council,  Olympia 

I  1982  Capacity  Building  Demonstration  Project.  Final  Report. 
Prepared  by  R.  Oilger . 


IMPLEMENTATION  REPORTS 


Center  for  Labor  Market  Studies,  Northeastern  University 

1980  Youth  Knowledge  Development  Report  (3.20),  CETA  Prime  Sponsor 
Self-Reviews .  Prepared  by  A.  Sum,  P.  Harrington,  and  G. 
Schneider . 

Center  for  Public  Service,  Brandeis  University 

1980  Youth  Knowledge  Development  Report  (8.6)  ,  Improving  the 
Implementation  of  YEDPA  Programs. 

Office  of  Youth  Programs,  Employment  and  Training  Administration,  U.S. 

Department  of  Labor 

1980  Youth  Knowledge  Development  Report  (12.2),  Linkages  Between 
Education  and  Employment  and  Training  Systems — Volume  I. 

1980  Youth  Knowledge  Development  Report  (12.3),  Linkages  Between 
Education  and  Employment  and  Training  Systems — Volume  II. 

1980  Youth  Knowledge  Development  Report  (12.5),  Work-education 
Councils — Collaborative  Approach. 

National  Collaboration  for  Youth  National  Assembly, 

1980  Youth  Knowledge  Development  Report  (12.1) 

Voluntary  Youth-Serving  Agencies. 

National  Council  on  Employment  Policy,  Washington,  D.C. 

1980  An  Anatomy  of  School-to-Work  Transition  Projects.  Prepared 
by  B.  Dunn  and  R.  Taggart. 


Washington,  D.C. 
,  Linking  with 


1980 


Youth  and  the  Local  Employment  Agenda:  An  Analysis  of  Prime 
Sponsor  Experience  Implementing  the  Youth  Employment  and 
Demonstration  Projects  Act.  Overview  and  Area  Summaries 
Final  Report.  Prepared  by  G.  Wurzburg . 

1980  Getting  There;  A  Case  Study  Report  on  the  Lives,  Employment 
Preparation,  and  Prospects  of  YEDPA  Participants.  Based  on 
the  Findings  of  the  Youth  Perspectives  Project  Conducted  fro 
November  1978-June  1979.  Prepared  by  B.  Snedeker . 

1980  Overview  to  the  Local  Focus  on  Youth;  A  Review  of  Prime 
Sponsor  Experience  Implementing  the  Youth  Employment  and 
Demonstration  Projects  Act.  Prepared  by  G.  Wurzburg. 

National  League  of  Cities,  Washington,  D.C. 

1980  Youth  Knowledge  Development  Report  (3.18),  CETA  Youth 
Programs  in  Small  Cities. 

Taggart,  Robert 

1980  Youth  Knowledge  Development;  The  Process  and  the  Product. 
Unpublished  paper. 


APPENDIX 

C 

Implications  of  the  Youth  Employment  Experience  for 
Improving  Applied  Research  and  Evaluation  Policy 

Robert  Boruch 

Try  all  things;  hold  fast  that  which  is  good. 

I  Thessalonians  51:21 


INTRODUCTION 


Determining  what  is  good  is  no  easy  matter.  The  purpose  of  this 
appendix  is  to  capitalize  on  hard  experience  in  making  that  judgment  in 
one  arena — employment  and  training  programs  supported  by  the  federal 
government. 

The  program  evaluations  reviewed  by  the  Committee  on  Youth 
Employment  Programs  have  a  variety  of  implications  for  evaluation 
policy.  The  aim  of  this  appendix  is  to  educe  some  of  those 
implications.  The  committee  also  relied  on  earlier  reviews  of  social 
and  educational  program  evaluation  generally  (Riecken  et  al.,  1974; 
Rivlin,  1971;  Raizen  and  Rossi,  1981;  the  U.S.  General  Accounting 
Office,  1978;  and  others). 

The  discussion  is  concerned  with  obtaining  better  evidence  with 
which  to  answer  fundamental  questions  about  youth  employment  and 
training  programs: 

•  Who  needs  the  services? 

•  How  well  are  services  delivered? 

•  What  are  the  relative  effects  of  the  service? 

•  What  are  the  relative  benefits  and  costs  of  alternative 
services? 

The  implications  are  grouped  into  two  simpler  categories: 

•  Improving  the  design  of  outcome  evaluations 

•  Improving  reporting 

Each  implication  is  followed  by  a  brief  description  of  evidence  and 
rationale. 


Robert  F.  Boruch  is  professor  of  psychology.  Center  for  Probability  and 
Statistics,  and  director.  Division  of  Methodology  and  Evaluation 
Research,  Northwestern  University. 
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IMPROVING  THE  DESIGN  OF  OUTCOME  EVALUATIONS 


Once  said,  it  is  obvious  that  quality  in  the  design  of  an  outcome 
evaluation  affects  the  quality  of  the  data  and  of  conclusions.  Poor 
designs  can  make  programs  look  worse  than  they  are,  or  better  than  they 
are,  or  yield  uninterpretable  evidence. 


Quality  and  Evaluation  Policy  in  General 

Quality  in  evaluation  design  ought  to  be  recognized  and  ought  to  be 
explicit  in  an  agency 8 s  evaluation  policy  and  in  congressional  oversight 
policy.  Special  efforts  need  to  be  made  to  improve  the  quality  of 
research  and  evaluation  designs  for  estimating  the  impact  of  youth 
employment  projects.  Existing  professional  guidelines  can  be  used  to 
influence  the  quality  of  design  and  the  quality  of  reporting. 

The  theme  of  quality  has  been  explicit  in  the  Department  of  Labor's 
Knowledge  Development  Plan,  insofar  as  the  plan  yoked  the  introduction 
of  new  programs  to  good  evaluation  design.  That  is,  the  plan  recog¬ 
nized  the  legitimacy  of  the  idea  that  good  impact  evaluations  can  only 
be  done  if  conditions  are  controlled  and  evaluation  is  planned  and 
begun  at  the  start  of  a  program.  This  theme  appears  also  in  the  U.S. 
General  Accounting  Office's  (1978)  attention  to  competing  explanations 
that  characterize  the  results  of  poor  research  designs,  to  the  elements 
of  reasonable  design,  and  to  the  need  for  designing  the  evaluation 
before  a  new  program  is  put  into  the  field. 

The  theme  has  been  recognized  by  the  courts  in  cases  that  recognize 
the  shortcomings  in  some  evaluation  designs  and  the  benefits  of  others, 
e.g.,  copayments  in  health  insurance.  Injunctions  have  been  issued 
against  poor  designs,  for  example,  and  challenges  to  good  designs  have 
been  defeated  (Breger,  1983,  for  specific  cases). 

Despite  this,  the  quality  of  evaluations  of  youth  employment  and 
training  programs  is  still  not  sufficiently  high.  Less  than  30  percent 
of  the  reports  examined  by  this  committee,  for  example,  were  of  high 
enough  quality  to  be  reviewed  seriously.  Projects  rejected  for  serious 
consideration  by  this  committee  were  flawed  by  the  lack  of  sensible 
comparison  groups,  unreliable  measures  of  program  outcome,  vague  objec¬ 
tives,  and  other  shortcomings.  Our  acceptance  rate  is  low,  but  it 
still  represents  progress.  Rossi's  (1969)  review  of  200  evaluations 
issued  by  the  Office  of  Economic  Opportunity  before  1968,  for  example, 
uncovered  no  randomized  field  experiments  and  only  about  25  reports 
with  credible  evidence. 

Professional  and  institutional  guidelines  for  improving  the  quality 
of  evaluation  designs  are  readily  available.  Section  A  of  the  bib¬ 
liography  lists  guidelines  that  pertain  to  evaluation  design  and 
reporting  in  health  and  health  services,  education  and  training, 
welfare,  and  other  areas.  The  references  include  applications  of 
standards  and  assessments  of  their  common  features  and  usefulness.  It 
would  not  be  unreasonable  to  adopt  variations  on  these  in  evaluation 
policy. 


Randomized  Field  Experiments 


Randomized  field  experiments  should  be  explicitly  authorized  in  law 
and  encouraged  in  evaluation  policy  as  a  device  for  estimating  the 
effects  of  new  projects,  program  variations,  and  program  components. 

Randomized  field  tests  of  new  programs ,  program  components,  or 
program  variations  are  a  scientifically  credible  device  for  obtaining 
interpretable  evidence  about  a  program9 s  effects.  But  they  are 
demanding  with  respect  to  the  requirement  that  individuals  or  schools 
or  other  organizational  units  must  be  assigned  randomly  to  program 
variations  or  to  program  versus  control  conditions. 

The  usefulness  of  randomized  tests,  in  principle,  is  generally  not 
at  issue  in  professional  discussions  about  estimating  the  impact  of 
programs.  That  is,  there  is  substantial  agreement  that  when  experiments 
are  conducted  properly,  estimates  of  effects  will  be  unbiased.  The 
conditions  under  which  experimental  design  can  be  or  should  be  employed 
are  more  debatable,  however  (e.g.,  Cronbach  and  others,  1980?  Boruch, 
1975).  How  precedent,  pilot  tests,  ethics,  and  law  constrain  or 
enhance  feasibility  is  considered  briefly  below. 


Precedent 

Some  opponents  of  controlled  randomized  tests  maintain  that 
randomized  experiments  are  rarely  feasible  in  field  settings.  The 
references  in  Section  B  of  the  bibliography  constitute  evidence  against 
the  claim:  the  reports  listed  cover  some  recent,  high-quality 
experiments. 

Randomized  field  tests  have  been  undertaken,  for  example,  to  get  at 
the  effects  of  new  law  enforcement  procedures  (Sherman  and  Berk,  1984, 
1985)  and  innovative  methods  for  improving  court  efficiency  (Partridge 
and  Lind,  1983) .  They  have  been  used  to  assess  the  relative  benefits 
and  costs  of  special  health  services  delivery  methods  and  practices, 
e.g.,  day  care  for  the  chronically  ill  and  medical  information  systems. 
They  have  produced  good  evidence  on  the  effects  of  diversion  projects 
for  delinquent  youths  in  California,  telephone  conferencing  in  adminis¬ 
trative  law  hearings  in  New  Mexico,  post-prison  subsidy  programs  in 
Texas  and  Georgia,  and  nutrition  education  projects  in  Nebraska. 

Not  all  attempts  to  use  randomized  field  tests  succeed,  of  course. 
The  procedure  may  and  indeed  has  been  corrupted  in  medical  experiments, 
e.g.,  early  tests  of  the  effects  of  enriched  oxygen  environments  on 
retrolental  fibroplasia  (Silverman,  1977)  .  And  they  have  failed  at 
times  in  formal  efforts  to  evaluate  court  procedures,  educational 
innovations,  and  other  social  programs  (e.g.,  Conner,  1977). 

Judging  from  precedent,  however,  it  is  not  impossible  to  assign 
individuals  or  other  units  randomly  to  programs  for  the  sake  of  fair 
estimates  of  program  effects.  Good  randomized  experiments  have  indeed 
been  mounted.  The  reasons  for  successes  and  failures  need  to  be 
studied. 


Pilot  Tests  of  Randomized  Experiments 

Precedent  is  persuasive  in  the  crudest  sensei  It  implies  that  what 
has  been  done  might  be  done  again.  Still,  experience  with  a  randomized 
trial  in  one  setting  may  be  irrelevant  in  others. 

For  this  reason,  pilot  tests  of  large-scale  field  experiments  are 
worth  considering.  That  is,  small  experiments  prior  to  the  main  field 
experiment  can  provide  evidence  on  feasibility  that  is  more  direct  than 
what  precedent  can  offer,  can  identify  problems  that  otherwise  could 
not  be  anticipated,  and  can  help  to  resolve  predictable  problems  before 
the  main  effort. 

That  there  can  be  major  problems  in  mounting  randomized  tests  is 
clear  from  the  Youth  Employment  Program  experience  (see  Section  C  of 
the  Bibliography) .  For  instance,  difficulties  were  encountered  in  the 
Tallmadge  and  Yuen  evaluations  of  the  Career  Intern  Program  and  the 
evaluation  of  the  Career  Advancement  Voucher  Demonstration  (CAVD) 
program  for  low-income  college  students  (Clark,  Phipps,  Clark  &  Harris, 
Inc.,  1981;  hereafter  CPC&H) .  Some  30  randomized  tests  of  Head  Start 
programs  were  initiated  in  the  late  1970s,  despite  counsel  for  pilot 
work:  fewer  than  10  succeeded.  Randomized  tests  have  also  been 
unsuccessfully  implemented  in  medicine,  law  enforcement,  and  other 
areas,  because  the  randomization  was  corrupted. 

That  attempts  to  run  good  randomized  trials  in  the  youth  employment 
sector  were  imperfect,  or  that  other  attempts  have  failed  miserably, 
should  not  be  unexpected.  Imperfection  and  failure  are  our  lot,  just 
as  improvement  is. 

The  pilot  test  strategy  has  helped  to  ensure  the  quality  of  field 
experiments  on  telephone  conferencing  in  the  administrative  court 
system.  For  instance,  city  tests  served  as  a  pilot  for  a  statewide 
experiment  in  administrative  appeals  in  New  Mexico  (Corsi  and  Hurley, 
1979)  .  The  strategy  has  also  been  used  to  enhance  quality  in  the  youth 
employment  program  research.  The  Supported  Work  Experiments  in  five 
cities  were  preceded  by  a  pilot  effort  in  one  city  by  the  Vera 
Institute,  and  it  did  have  a  bearing  on  the  quality  of  those  experi¬ 
ments.  The  approach  seems  sensible  in  view  of  these  efforts,  the 
failed  efforts,  and  experience  from  other  areas.  Hahn 9 s  (1984)  advice 
in  the  industrial  commercial  sector  is  similar,  for  similar  reasons. 


Ethics 

Where  there  is  an  over supply  of  eligible  recipients  for  scarce 
program  services,  randomized  assignment  of  candidates  for  the  resource 
seems  fair.  Vancouver ' s  Crisis  Intervention  Program  for  youthful 
offenders,  for  instance,  offered  equal  opportunity  to  eligible  recipi¬ 
ents.  Since  all  participants  could  not  be  accommodated  well  with 
available  program  resources,  but  were  all  equally  eligible,  they  were 
randomly  assigned  to  program  or  control  conditions. 

More  generally,  randomized  experiments  are  most  likely  to  be 
regarded  as  ethical  when  the  services  are  in  short  supply,  their 
effectiveness  is  not  clear,  and  someone  is  interested  in  effectiveness. 


This  rationale  dovetails  neatly  with  some  managerial  constraints.  That 
is,  despite  the  aspirations  of  program  advocates,  new  programs  cannot 
be  emplaced  all  at  once,  but  must  be  introduced  in  stages,  e.g.,  ser¬ 
vices  are  delayed  for  some.  The  argument  for  the  ethicality  of  random 
assignment  to  scarce  resources  is  not  especially  pertinent  when  the 
manager  can  simply  spread  resources  more  thinly,  e.g.,  by  expanding  the 
size  of  classes  dedicated  to  special  instruction  in  tests  of  training 
projects. 


Law 


Randomized  field  tests  have  received  attention  only  recently  from 
the  courts  and  from  constitutional  scholars.  The  attention,  however, 
has  been  thorough  and  productive. 

Pertinent  court  decisions,  for  example,  include  Aguayo  v.  Richardson 
and  California  Welfare  Rights  Organizations  v.  Richardson.  These  cases 
challenged  the  use  of  randomized  experiments  in  assessing  welfare  pro¬ 
grams,  but  the  challenges  were  dismissed  by  the  court.  Legal  analyses 
of  such  cases  are  given  by  Breger  (1983)  and  Teitelbaum  (1983) ;  Bermant 
et  al.  (1978) ,  Federal  Judicial  Center  (1983) ,  and  Rivlin  and  Timpane 
(1975)  give  more  general  treatments.  Statutes  that  recognize  the 
legitimacy  of  randomized  experiments  are  scarce,  however,  and  that  is 
one  reason  for  recommending  explicit  reference  to  randomized 
experiments  in  law. 


The  People  Targeted  for  Services:  Characteristics,  Access,  and  Number 

Surveys  prior  to  mounting  a  field  test  are  essential  to  ensure  that 
people  targeted  for  service  or  action  are  (a)  identifiable,  (b) 
trainable  in  the  experimental  regimen  and  (c)  sufficient  in  number  to 
warrant  the  investment  in  a  controlled  randomized  experiment. 

Program  managers  sometimes  promise  to  randomize  because  they  presume 
the  target  population  is  large  enough  to  permit  random  assignment  of 
individuals  to  "program"  versus  "control"  conditions  or  to  program 
variations.  The  presumption  has  been  wrong  at  times  in  medical 
research,  e.g.,  experiments  in  day  care  for  the  chronically  ill  during 
the  late  1970s.  It  has  also  been  wrong  in  educational  research,  notably 
in  attempts  to  do  randomized  field  experiments  on  Head  Start  preschool 
programs  and  in  planned  variations.  And  it  has  been  wrong  in  manpower 
training  programs  prior  to  1966,  to  judge  from  Rossi9 s  (1969)  descrip¬ 
tion  of  the  National  Opinion  Research  Center's  (NORC's)  failure  to 
recruit  enough  clients  for  experimental  tests  of  an  employment  training 
program.  If  there  are  too  few  individuals  in  need  of  the  service  and 
who  are  accessible  and  willing  to  participate,  one  will  be  unable  to 
execute  an  experiment  well. 

The  reasons  for  error  in  the  presumption  include  ignorance:  It  is 
often  very  hard  to  estimate  the  number  of  those  in  need  of  special 
services,  harder  to  identify  them,  and  at  times  harder  still  to  under¬ 
stand  how  to  train  them  in  a  program.  They  include  greed,  of  course. 


The  funds  made  available  for  a  special  program  and  for  an  experiment 
produce  inflated  counts  of  those  in  need. 

Regardless  of  the  reasons  for  the  error,  the  matter  is  important 
we  expect  to  have  decent  tests  implemented.  What  do  the  youth  employ 
ment  experiments  tell  us  about  this? 

For  the  Manpower  Demonstration  Research  Corporation  (MDRC) ,  there 
seems  to  have  been  no  remarkable  problems  in  identifying  and  enrollin' 
members  of  various  target  groups  for  the  Supported  Work  Program.  Sti 
MDRC  says  it  may  not  have  focused  sufficiently  well  on  the  right  targ' 
group  in  its  explanation  of  why  effects  on  youths  fail  to  be  substan¬ 
tial.  Nor  is  there  any  reference  to  shortfall  in  the  reports  by  the 
Vera  Institute  on  the  Alternative  Youth  Employment  Strategies  Project 
The  report  on  the  Opportunities  Industrialization  Center  (OIC)  projec 
(O'Malley  et  al.,  1981)  is  ambiguous  on  this  account. 

In  the  CAVD  program,  on  the  other  hand,  "All  CETA  prime  sponsors 
were  to  recruit  a  pool  of  at  least  200  youths  between  the  ages  of 
sixteen  and  twenty-one  who  met  YETP  eligibility  requirements  and  who 
desired  and  were  available  for  full  time  work"  (CPC&H,  1980:15).  Som 
150  to  170  were  eventually  assigned  to  alternative  treatments.  The 
target  sample  size  was  partly  a  function  of  local  screening  criteria. 
Recruitment  and  assignment  difficulty  is  discussed  in  the  report 
(CPC&H,  1980) .  Difficulty  in  recruitment  was  encountered  in  four  of 
five  sites.  In  three  sites,  the  difficulty  seems  serious,  said  to  be 
caused  by  internal  organizational  problems  (e.g. ,  a  move  to  a  differe 
building)  or  interinstitutional  problems  (e.g.,  one  agency  doing  the 
screening,  another  the  program  implementation) . 

Similarly,  the  Project  STEADY  evaluation  reported  that  "sufficien 
numbers  of  youth  were  difficult  to  recruit"  and  that  start-up  time  fo 
the  program  was  brief  according  to  site  directors  (Grandy,  1981) .  Th 
SPICY  project  for  Indochinese  youths  was  targeted  for  120  youths  per 
site,  but  obtained  only  70  to  80  individuals.  The  Tallmadge  and  Yuen 
report  on  Career  Education  programs  suggests  that  only  three  rather 
than  four  cohorts  (with  a  projected  75  per  cohort)  were  enrolled  at 
each  of  the  four  sites.  Further,  the  first  two  of  the  three  cohorts 
contained  fewer  than  the  75  members  that  were  forecast  (an  extension 
the  period  led  to  complete  cohorts).  Hahn  and  Friedman's  evaluation 
the  Cambridge  Job  Factory  for  out-of-school  youths  encountered  proble 
in  recruitment  because  there  were  related  summer  programs  in  the  same 
area.  Their  work  in  Wilkes-Barre  suggests  the  enrollment  problem  was 
severe  in  that  area  (53  percent  of  target  reached)  and  that  it  affect 
both  the  Youth  Employment  Service  Program  and  the  Employer -Voucher 
Program.  The  problem  was  attributed  to  competing  CETA  programs. 

A  few  of  the  experiments  at  hand  also  tell  us  something  about  the 
tractability  of  problems  in  the  target  population.  The  Supported  Wor 
Program  run  by  MDRC,  for  instance,  suggests  that  women  receiving  Aid 
Families  with  Dependent  Children  profit  more  than  young  people  do  fro 
the  services  provided,  it  is  not  clear  that  "tractability"  can  be 
assessed  well  in  prior  surveys  of  a  targeted  group.  The  experience 
does  suggest  that  it  is  important  to  separate  ostensibly  different 
subgroups  in  the  experiment  and  to  establish  that  their  members  can  b 
identified  well  in  prior  surveys. 


Sensitivity  of  Field  Experiments 


Statistical  power  analyses  and  reporting  on  the  analyses  are 
important  and  ought  to  be  undertaken  routinely.  This  is  elemental 
quality  assurance  for  any  evaluation  policy. 

By  power  analysis  here  is  meant  formal  calculation  of  the  probabil¬ 
ity  of  finding  an  effect,  if  there  indeed  is  an  effect,  despite  a  noisy 
context.  Critical  reviews  of  field  experiments  in  health  services, 
education,  and  other  areas  stress  that  (a)  the  effects  of  projects  will 
usually  be  small  and  (b)  sample  sizes  are  often  too  small  to  detect 
those  effects.  That  is,  differences  between  program  and  control  groups 
are  likely  to  go  undetected. 

Three  of  the  experiments  reviewed  by  this  committee  had  samples 
large  enough  to  justify  the  expectation  that  an  effect  would  be  detected 
if  indeed  youths  were  influenced  by  the  regimen.  The  Vera  Institute's 
study,  for  example,  involved  600  to  800  individuals  per  site,  with 
about  300  in  a  control  group  and  100  in  each  of  three  program  variation 
groups.  OIC  had  about  1,500  participants  and  700  controls  distributed 
across  seven  sites.  MDRC's  sample  size  exceeded  1,200,  over  five  sites. 

Other  experiments  listed  in  Section  C  of  the  Bibliography  involve 
far  smaller  samples,  however.  And  so  it  is  difficult  to  understand  how 
a  small  project  effect  could  be  detected.  The  CAVD  project,  for 
example,  involved  assignment  of  fewer  than  30  individuals  per  group  in 
each  site.  Attrition  led  to  even  fewer,  e.g.,  4  individuals  in  a  site 
in  one  analysis  of  dropouts.  And  so  it  is  no  surprise  that  differences 
among  groups  are  often  insignificant.  The  Indochinese  SPICY  project 
had  70  to  80  individuals  per  site  in  three  sites  and  analyzed  the  sites 
separately.  (They  did  detect  effects.)  Tallmadge-Yuen ' s  Career  Intern 
report  suggests  that  there  were,  at  most,  75  subjects  per  cohort  per 
site;  there  is  no  reference  to  a  power  analysis  in  the  final  report, 
and  results  are  mixed. 


Measures  of  Program  Implementation 

More  orderly,  verifiable  information  on  the  degree  of  program 
implementation  needs  to  be  collected.  Better,  less-expensive  methods 
for  obtaining  and  reporting  such  information  also  need  to  be  developed. 
And  basic  research  needs  to  be  conducted  to  link  implementation  data 
with  impact  data. 

No  outcome  evaluation  should  exclude  measurement  of  the  level  of 
program  implementation.  Such  data  are  as  essential  in  social  program 
evaluation  as  measurements  of  dosage  level  and  compliance  are  in  evalu¬ 
ating  new  drugs  and  therapy. 

At  its  crudest,  measuring  implementation  may  focus  on  structural 
features  of  the  program's  construction.  This  includes  establishing  the 
time  frame  required  for  actualizing  major  parts  of  program  plans. 
Information  about  the  time  it  takes  for  a  new  program  to  become  stabil¬ 
ized,  for  instance,  is  often  sketchy  even  for  large-scale  programs. 
Measurement  should  include  crude  observation  on  staff,  material,  and 
resources,  and  on  the  recipients  of  services  and  their  eligibility. 


report,  for  example,  stresses  staffing  problems  at  all  four  experimental 
sites,  problems  that  are  said  to  be  attributable  to  "extremely  com¬ 
pressed  time  schedules  and  bad  timing  associated  with  start  up  opera¬ 
tions."  Related  reports  cover  actual  program  composition  and  the 
qualitative  features  of  client  and  program  interaction. 

It  seems  sensible  also  to  establish  what  kinds  of  services  are 
offered  to  control  group  members.  For  they,  too,  may  participate  in 
other  programs  that  are  implemented  to  some  degree.  This  measurement 
seems  especially  important  insofar  as  20  to  40  percent  of  control  group 
youths  in  a  given  site  may  in  fact  avail  themselves  of  services  from 
other  sources. 

The  problems  of  assuring  that  treatments  are  delivered  as  adver¬ 
tised,  of  measuring  the  degree  of  implementation,  and  of  understanding 
how  to  couple  implementation  data  and  experimental  data  are  not  confined 
to  the  youth  employment  arena,  of  course.  Poorly  planned  and  executed 
programs  occur  in  the  commercial  sector,  though  information  about  this 
is  sparse  for  obvious  reasons  (see  Hahn,  1984) .  Despite  good  planning, 
meteorological  experiments  have  been  imperfect  and  admirably  well 
documented  (Braham,  1979) .  Drug  trials  and  other  randomized  clinical 
trials  in  medicine  must  often  accommodate  departures  from  protocol  and 
noncompliance  (e.g.,  Silverman,  1977).  And  so  on. 


"Evaluability" 

The  extent  to  which  projects  and  programs  are  "evaluable"  should  be 
routinely  established  before  large-scale  evaluation  is  undertaken. 

Not  all  programs  can  be  evaluated  with  the  same  level  of  certainty. 
New  projects,  for  instance,  often  present  better  opportunities  for 
obtaining  interpretable  estimates  of  project  effects  than  ongoing 
ones.  It  is  also  clear  that  limitations  on  resources  and  experience 
prevent  even  new  programs  from  being  evaluated  well. 

The  need  to  anticipate  how  well  one  might  be  able  to  evaluate  has 
generated  interest  in  the  "evaluability"  of  programs.  The  idea  of 
formal  evaluability  assessment,  proposed  by  Joseph  Wholey  and  extended 
by  Leonard  Rutman  and  others,  involves  addressing  specific  questions 
about  whether  an  evaluation  can  be  designed  to  provide  useful  infor¬ 
mation  in  a  particular  setting,  especially  whether  decisions  or  changes 
can  be  made  on  the  basis  of  the  information.  It  has  been  suggested 
that  the  approach  be  employed  before  demanding  evaluation  in  every 
instance. 

Evaluability  assessment  has  received  some  support  and  pilot  testing 
in  Canada  and  the  United  States  (Wholey,  1977;  Rutman,  1980).  The 
strategy  is  imperfect  in  that  it  asks  one  to  predict  success  based  on 
experience  that  may  not  exist.  But  it  is  useful  in  identifying  the 
senses  in  which  evaluation  is  possible  and  potentially  helpful.  It  is 
a  promising  device  for  avoiding  unnecessary  effort. 


More  to  the  point,  the  idea  is  to  learn  how  to  avoid  putting  money 
into  evaluations  that  cannot  be  done  well  or  are  likely  to  be  useless. 
More  generally,  the  approach  can  provide  a  framework  for  understanding 
how  to  achieve  compromises  between  the  desirability  of  special  designs, 
such  as  a  randomized  experiment,  and  operational  constraints  of  the 
program,  and  for  understanding  the  kinds  of  evaluation  that  will  be 
useful. 


Testing  Components  and  Variations 

Testing  the  components  of  programs  is  warranted,  especially  when 
tests  of  full  programs  are  not  feasible  or  appropriate. 

No  theory  of  evaluation  demands  that  the  effects  of  an  entire 
program  be  estimated.  Few  practitioners  would  regard  the  requirement 
as  reasonable.  Yet  rhetoric  and  legislative  mandates  foster  this  view, 
distracting  attention  from  the  possibility  of  testing  important 
components  of  programs  or  variations  on  them.  For  example,  one  may 
find  that  running  high-quality  tests  of  an  entire  training  program  is 
not  possible.  But  estimating  the  effect  of  alternative  sources  of 
information,  ways  of  presenting  information,  ways  of  enhancing  use  of 
information,  and  so  on,  may  be  possible  in  small,  high-quality 
experiments . 

The  strategy  has  been  exploited  in  a  few  youth  employment  program 
evaluations,  in  research  which  preceded  development  of  Sesame  Street, 
and  in  experiments  on  surgical  and  health  innovation.  Incorporated 
into  evaluation  policy,  the  idea  broadens  options.  And  in  the  event  of 
a  major  evaluation's  failure,  it  is  a  device  for  assuring  that  at  least 
parts  of  the  program  can  be  assayed  well. 


Attrition 

Far  better  methods  need  to  be  invented  and  tested  to  control 
attrition  and  to  understand  its  effects  on  analysis.  Resources  need  to 
be  dedicated  to  the  activity. 

Individuals  who  voluntarily  participate  in  any  social  program  are 
also  free  to  abandon  the  program.  Individuals  who  participate  in  a 
randomized  control  group  or  some  alternative  to  which  they  have  been 
randomly  assigned — by  answering  questions  about  their  work  activity  for 
instance — are  also  free  to  withdraw. 

The  loss  of  contact  with  individuals  in  either  group  is  important 
insofar  as  it  affects  how  easily  and  confidently  one  can  interpret  the 
results  of  an  experiment.  To  put  the  matter  simply,  if  contact  is  lost 
with  individuals  in  both  groups,  there  is  no  way  to  determine  the 
project's  impact  on  participants. 

If  the  program  maintains  good  contact  with  the  participants,  for 
instance,  but  fails  to  track  nonparticipants  well,  it  may  generate 
evidence  that  makes  the  program  look  damaging  when  in  fact  it  is 
ineffectual,  or  that  makes  the  program  appear  effective  when  in  fact 
its  impact  is  negligible  or  even  negative. 
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When  the  attrition  rate  in  the  program  group  differs  appreciably 
from  the  rate  in  the  control  group,  making  inferences  is  more 
complicated.  Suppose,  for  instance,  that  all  individuals  who  "attrit" 
in  the  control  group  found  jobs.  Analysis  that  fails  to  recognize  this 
would  probably  produce  inflated  estimates  of  the  program's  effect. 

Problems  in  attrition  in  field  experiments  were  sufficiently 
critical  to  warrant  the  committee's  rejecting  over  half  of  them  for 
serious  review.  This  does  not  always  imply  that  the  work  was  unsal- 
vageable,  merely  that  resources  do  not  permit  determining  if  the 
analytic  problems  engendered  by  attrition  could  be  resolved.  CAVD's 
differential  in  rate  of  interviewing,  for  instance,  is  substantial, 
e.g.,  80  percent  for  the  participants  and  50  percent  for  controls. 

There  is  no  discussion  of  the  potential  problems.  There  is  no  attempt 
to  accommodate  them  in  the  report  at  hand.  The  Vera  Institute  (Sadd  et 
al.,  1983:18),  on  the  other  hand,  reported  about  equal  rates  of 
attrition,  e.g.,  "premature  dropout  was  substantial  and  depended  on 
(program)  model,"  but  there  are  no  details.  Interview  completion  rates 
are  given  in  the  60  to  84  percent  range  for  the  program  group  and  in 
the  60  to  84  percent  range  for  the  control  group. 

The  Tallmadge  and  Yuen  study  of  the  Career  Intern  Project  is 
unusual  in  having  tried  to  accommodate  the  possible  biases  due  to 
differential  attrition  by  matching  individuals  first  and  then  keeping 
only  full  pairs  for  analysis.  For  all  four  sites,  they  got  rates  in 
the  50  to  70  percent  range. 

OIC  does  no  formal  analysis  of  the  effect  of  attrition.  Their 
report  does,  however,  give  completion  rates  and  rates  at  which  com¬ 
parison  groups  have  access  to  programs.  They  ignore  these  differences 
in  their  analysis  or  discard  controls  who  did  become  involved  in 
programs.  Nothing  is  said  about  cooperation  3  and  8  months  after 
program  completion  though  they  give  data  on  each  point. 

The  Project  STEADY  report  is  conscientious  in  providing  a  table 
that  illustrates  the  flow  and  attrition  rate  at  various  stages  in  the 
experiment  (Educational  Testing  Service,  1981:Table  1,  p.  26) .  It  is  a 
shame,  however,  that  no  serious  statistical/analytic  attention  was 
brought  to  bear  on  this. 


Coupling  Experiments  to  Longitudinal  and  Panel  Studies 

Randomized  experiments  ought  to  be  coupled  routinely  to  longi¬ 
tudinal  surveys  and  panel  studies.  The  purposes  of  this  "satellite" 
policy  include  calibration  of  nonrandomized  experiments,  more  general- 
izable  randomized  experiments,  and  better  methods  for  estimating 
program  effects. 

Longitudinal  surveys  based  on  well-designed  probability  samples  are 
clearly  useful,  for  science  and  policy,  in  understanding  how  individuals 
(or  institutions)  change  over  time.  For  example,  they  avoid  the  logical 
traps  that  cross-sectional  studies  invite,  such  as  overlooking  cohort 
effects,  in  economic,  psychological,  and  other  research. 

Such  studies  are,  however,  often  pressed  to  produce  evidence  that 


of  social  programs  on  groups  that  the  longitudinal  study  happens  to 
include.  So,  for  example,  the  Continuous  Longitudinal  Manpower  Survey 
(CLMS)  has  been  justified  and  supported  primarily  on  grounds  that  one 
ought  to  understand  what  happens  to  the  human  resources  pool.  Its 
secondary  or  tertiary  justification  is  that  it  can  help  one  understand 
the  effect  of  special  programs — in  youth  employment,  training,  and  so 
on. 

Such  justification  may  be  useful  for  rhetorical  and  scientific 
purposes.  But  it  is  dysfunctional  insofar  as  the  claim  is  exaggerated. 
That  is,  longitudinal  surveys  are  often  not  sufficient  to  permit 
confident  estimation  of  the  effect  of  programs  designed  to,  say,  affect 
earnings  of  individuals  who  happen  to  be  members  of  the  sample,  crime 
rates  of  those  people,  and  so  on. 

That  the  claims  made  for  longitudinal  surveys  with  respect  to 
evaluation  of  programs  can  be  misleading  is  clear  empirically  and 
analytically.  The  most  dramatic  recent  empirical  evidence  stems  from 
Fraker  and  Maynard's  (1985)  comparisons  of  program  effects  based  on 
randomized  experiments  and  effects  based  on  nonrandomized  data,  notably 
the  CLMS  and  the  Current  Population  Survey.  Earlier  evidence  in  differ¬ 
ent  arenas  stems  from  the  Salk  polio  vaccine  trials,  health  services 
research,  and  others  (see  Boruch,  1975,  for  listing). 

Randomized  experiments,  on  the  other  hand,  permit  one  to  estimate 
the  effects  of  projects  with  considerably  more  confidence.  Indeed  the 
committee  report  is  emphatic  on  this  account.  A  major  shortcoming  of 
experiments,  one  not  shared  by  the  large-scale  longitudinal  studies,  is 
their  limited  generalizability.  That  is,  a  set  of  experiments  might  be 
feasible  in  only  a  half-dozen  sites,  sites  that  do  not  necessarily 
reflect  national  characteristics. 

The  implication  is  that  one  ought  to  invent  and  try  out  research 
policy  that  helps  to  couple  the  benefits  of  longitudinal  studies,  i.e., 
generalizability,  with  those  of  experiments,  i.e.,  unbiased  estimates 
of  program  effect. 

This  policy  element  is  akin  to  science  policy  on  satellite  use. 

That  is,  the  satellite,  like  the  longitudinal  study,  requires  enormous 
resources  to  emplace  and  maintain.  It  pays  to  capitalize  on  them. 
Further,  the  scientist  who  designs  special-purpose  studies  can  obtain 
access  to  part  of  the  satellite  to  sustain  his  or  her  investigation. 

Just  as  the  physicist  then  may  use  the  satellite  as  a  vehicle  for 
limited,  temporary  investigation,  the  policy  recommended  here  allows 
the  researcher  the  option  of  using  longitudinal  infrastructure  as  a 
resource  and  as  a  vehicle  for  conducting  prospective  studies. 

The  policy  element  gets  well  beyond  simple  scientific  traditions  of 
"data  sharing"  (Committee  on  National  Statistics,  1985) .  It  is  con¬ 
siderably  more  debatable  and  more  important  in  principle.  Access  is 
likely  to  be  feasible,  for  example,  only  for  a  few  projects,  perhaps 
only  one  every  year  or  two,  because  of  the  sheer  difficulty  of  coupling 
studies  to  an  already  complex  longitudinal  enterprise. 


Theory;  Amateur  and  Otherwise 


The  theories  underlying  programs  are  often  puny  at  best  am 
fragmented  and  poorly  articulated  at  worst.  They  need  to  be 
strengthened  and  coupled  to  evaluation  design.  Resources  have 
dedicated  to  the  effort. 

Even  in  the  engineering  sciences,  elements  of  theory  are  a 
weak  and  ambiguous.  And  applications  of  well-explored  theory, 
classical  mechanics  and  the  conflation  of  several  complex  theo: 
laws  operating  in  a  complex  environment,  may  lead  to  analytic  ] 
that  are  intractable.  And  so,  it  is  not  uncommon  to  design  rai 
experiments  to  assess  changes  in  chemical  production  processes 
acoustics,  and  other  areas  (e.g.,  Hahn,  1984). 

The  same  problems  occur  in  the  social  sector  of  course,  in 
Moreover,  the  science  is  young  so  good  theories  are  not  in  abui 
supply.  Indeed,  the  absence  of  formal,  well-explicated  theory 
justification  for  randomized  trials  in  the  social  sector,  just 
experiments  are  sometimes  a  last  ditch  effort  to  achieve  under: 
in  the  engineering  arena. 

To  be  sure,  commonsense  notions  of  how  a  program  is  suppos 
produce  an  effect  is  theory  of  sorts.  Most  aphorisms  are  pres< 
theories.  But  such  theory  is  not  accurate  simply  by  virtue  of 
ence,  its  amateur  status,  or  the  desirability  of  results  that 
theory-based  program  is  supposed  to  produce.  Which  means  the 
and  the  program  based  on  it  may  also  be  inaccurate. 

Examples  of  inadequate  commonsense  theory  and  of  well-artl 
theory  are  easy  to  find.  There  is  room  for  improving  both  var 
different  ways.  One  of  the  ways,  for  Chen  and  Rossi  (1980)  is 
the  theorist,  rather  than  only  the  program  administrator,  choo; 
outcome  variables  that  are  likely  to  be  influenced  by  what  the 
is  supposed  to  do.  The  administrator  may  believe  that  program 
affect  salaries,  for  example.  But  the  theorist  may  recognize 
the  time  available,  salary  changes  may  be  undetectable  and  ins 
ought  to  measure  more  immediate,  plausibly  expected  effects  on 
skill  or  knowledge  level.  The  benefit  is  enhancing  the  likeli 
detecting  some  effect,  in  the  short  run,  and  theory  enhancemen 
long  run. 

The  need  for  enlarging  the  supply  of  good  theory  seems  obv 
take  a  simple  variable  such  as  time,  for  instance,  few  formal 
behavioral  theories  have  been  laid  out  (partly  because  experie 
sparse)  to  explain  the  time  required  for  a  new  project's  stabi 
time  required  on  tasks  to  produce  effects  on  skills,  time  requ 
benefit  through  skills  in  the  market  place,  or  time  involved  i 
decay  of  benefits.  Yet  theory  that  incorporates  time  variable 
essential  to  designing,  executing,  and  evaluating  programs  wel 

More  complicated  examples  are  not  hard  to  develop.  For  ex 
so-called  selection  models  have  been  developed  by  Heckman  and 
(1985),  among  others,  to  describe  analytically  how  program  app 
wind  up  in  one  program  regimen  versus  another.  The  approach  s 
sensible  insofar  as  it  leads  to  a  substitute  for  experiments  a 
analyses  of  nonrandomized  trials. 


Such  models  are  in  fact  small  theories  and  they  have  the  merit  of 
being  explicit  and  often  ingenious.  Their  shortcomings  lie  in  their 
parochialism;  each  is  a  notion  developed  by  a  mathematically  oriented 
analyst,  who  is  unlikely  to  have  (a)  come  within  sniffing  distance  of  a 
real  program,  i .e. ,  not  done  empirical  studies  of  the  enrollment  process 
and  (b)  taken  the  trouble  to  exploit  theory  from  disciplines  outside 
economics . 

For  example,  it  takes  no  wit  to  recognize  that  enrollment  processes 
involve  information,  supplied  to  and  available  to  administrator  and 
applicant,  and  decisions  by  each.  The  information  is  processed  under 
constraints?  the  decisions  are  made  under  constraints.  Why  then  do  we 
not  exploit,  say,  the  theories  and  rules  of  cognitive  processing  that 
have  been  developed  over  the  past  10  years  by  Herbert  Simon,  Kahneman 
and  Tversky,  and  others  to  develop  something  more  realistic  and  more 
coherent  than  the  simplistic  selection  models  that  the  ill-informed 
analyst  might  choose?  The  reason  seems  to  lie  more  in  disciplinary 
provincialism  than  in  any  inherent  weaknesses  in  either  kind  of  model. 

The  point  is  that  far  more  integration  of  theory  and  practical 
program  development  and  evaluation  is  warranted.  Absent  the  integra¬ 
tion,  it  is  doubtful  that  one  will  learn  much  that  is  durable. 


IMPROVING  THE  QUALITY  AND 
INTERPRETABILITY  OF  EVALUATION  REPORTS 

The  quality  of  evaluation  reporting  can  be  improved  substantially 
by  adhering  to  professional  guidelines  issued  over  the  past  five  years. 

Documentation  on  large-scale  evaluations  is  generally  much  better 
than  the  information  usually  available  on  smaller,  locally  managed 
ones.  Nonetheless,  there  are  notable  gaps  in  what  is  known  about  even 
the  large  ones.  Information  is  not  always  presented  in  accord  with 
reasonable  reporting  standards  issued,  for  example,  by  the  Evaluation 
Research  Society  (1982),  the  U.S.  General  Accounting  Office  (1970),  and 
other  organizations,  and  by  individual  experts,  such  as  Mosteller  et 
al.  (1980)  (in  clinical  trials  section  of  the  bibliography) . 

The  weaknesses  in  reporting  make  it  difficult  to  screen  and 
summarize  results  for  policy,  as  this  committee  has  tried  to  do.  And 
the  weaknesses  complicate  efforts  to  develop  quantitative  syntheses  of 
multiple  experiments  so  we  may  judge  how  sizes  of  program  effect  vary. 
[See  Light  and  Pillemer  (1984)  and  Cordray  and  Orwin  (1985)  on 
synthesis  and  the  problems  that  poor  reporting  engenders.] 

Doubtless  some  good  projects  have  been  ignored  because  reporting  is 
poor.  Good  projects  are  not  exploited  as  much  as  they  should  be 
because  information  provided  in  reports  is  insufficient. 

So,  for  example,  the  best  reports  tell  us  what  the  attrition  rate 
is  from  programs  or  from  program  versus  control  groups.  But  many 
reports  do  not.  The  best  of  the  best  educe  the  implications  of 
attrition  and  how  they  have  been  taken  into  account  to  produce  fair 
estimates  of  program  effect.  Most  do  not.  The  gaps  make  it  very 
difficult  to  review  the  quality  of  evaluations  and  to  adjust  for 
quality  of  evaluation  in  gauging  the  success  of  multiple  programs. 
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The  topics  that  should  be  routinely  considered  in  such  reports  ar< 
easy  to  list.  The  following  are  based  on  fuller  treatments  in  the 
references  cited. 


Attrition  Rates 

The  difference  between  the  ultimate  target  samples  of  program  par¬ 
ticipants  and  control-group  members  is  crucial.  Estimates  of  program 
effect  may  be  inflated,  deflated,  or  remain  unchanged,  relative  to 
their  true  value,  depending  on  the  magnitude  of  attrition  in  the  grou] 
Yet  attrition  rates  are  sometimes  not  reported.  Nor  are  differen< 
reported.  Even  less  frequently  reported  are  analyses  of  how  sensitiv< 
the  conclusions  are  to  the  rates  and  to  differences  in  the  rates. 


Character  of  Program 

Understanding  what  happens  in  a  program  is,  of  course,  important; 
developing  orderly,  inexpensive  descriptions  of  what  happens  is  diffi- 
cult.  This  does  not  excuse  one  from  trying  to  document  program 
activity  well.  Little  reporting  has  been  undertaken,  partly  perhaps 
because  of  a  lack  of  understanding  of  how  to  measure  the  level  of 
program  implementation  well. 


Access  to  the  Data  Base 

Assuring  that  raw  research  data  are  accessible  for  reanalysis,  in 
the  interest  of  facilitating  criticism  and  secondary  analysis,  is  not 
common.  Still,  it  seems  sensible  to  advance  understanding  of  how  to 
exploit  costly  information  better  and  how  to  encourage  thoughtful 
criticism  (see  Fienberg  et  al.,  1985).  The  implication  for  research 
policy  in  this  arena  is  that  reports  should  routinely  inform  the  read' 
about  what  raw  data  are  available  and  from  whom. 

The  vehicles  for  assuring  the  data  that  are  available  include  the 
normal  contract  system  and  agencies  responsible  for  overseeing 
evaluations. 


Target  Population/Recruitment 

The  general  characteristics  of  youths  targeted  for  programs  are 
usually  a  matter  of  law  or  regulation  and  are  usually  reported. 
Demographic  characteristics  of  the  sample  are  also  reported. 

But  how  youths  are  recruited,  what  fraction  of  the  available 
population  is  involved,  and  what  kinds  of  problems  were  encountered  i 
targeting  are  often  not  reported  or  given  only  superficial  treatment. 
As  a  consequence,  it  would  be  difficult  to  replicate  the  program  even 
if  it  were  found  to  be  successful.  And  it  is  difficult  for  the 
thoughtful  observer  to  reconcile  conflicts  among  the  results  of 
different  studies. 
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Perhaps  most  important,  shortfalls  between  target  and  actual 
samples  occurred.  Understanding  the  magnitude  of  the  shortfall  and  the 
reasons  for  it  are  crucial  to  designing  better  evaluations. 


Site  Selection 

Many  of  the  field  tests  of  youth  employment  programs  involve 
multiple  sites.  The  9  randomized  trials  reviewed  seriously  by  the 
committee,  for  example,  involve  a  randomized  experiment  in  each  of  40 
sites . 

Very  little  information  is  provided  on  site  selection  in  final 
reports,  however.  The  information  is  important  for  understanding  the 
general  context  of  the  test,  perhaps  for  understanding  why  the  program 
succeeded  or  failed  and  why  the  evaluation  was  executed  poorly  or  well, 
and  for  learning  whether  and  how  the  evaluation  might  be  replicated. 

Final  results  need  not  provide  great  detail  on  site  selection. 
Nonetheless,  a  reference,  footnote,  or  paragraph  ought  to  provide  leads 
to  accessible  sources  of  written  information  on  the  topic. 


Random  Assignment 

The  specific  method  for  randomly  assigning  individuals  to  alter¬ 
native  regimens  is  rarely  reported.  The  methods  may  be  mundane.  Or 
they  may  be  creative  in  the  sense  of  being  robust  against  indifference, 
incompetence,  and  corruption.  In  any  case,  reporting  on  method  is 
warranted  in  a  footnote  or  appendix  to  assure  the  reader  that  indeed 
the  study  was  carried  out  as  an  experiment  and  to  permit  praise  and 
criticism  of  the  random  assignment  process  [see  Dobson  and  Cook  (1979)]. 

For  example,  the  specific  mechanics  of  randomization  are  not 
described  in  any  final  report  on  youth  employment  projects  listed  in 
Section  C  of  the  Bibliography.  There  are  no  citations  to  reports  that 
may  contain  the  information. 

But  broad  information  is  given  by  some.  The  Tallmadge  and  Yuen 
report  on  the  Career  Intern  Program,  for  instance,  gives  no  detail 
except  to  say  that  assignment  was  by  "lottery."  The  report  on  the  OIC 
project  (O'Malley  et  al.,  1981:34)  says  that  individuals  were  randomly 
assigned  to  program  versus  control  groups  but  that  "there's  no  firm 
assurance  that  in  all  cases  the  participants  were  randomly  assigned." 

The  "most"  detail  on  the  topic  is  given  in  the  final  report  for 
Project  STEADY.  Grandy  (1981:17)  reports  that  "Project  STEADY 
participants  consisted  of  random  samples  of  program  applicants.  Site 
directors  reported  that  all  applicants  drew  a  card  from  a  hat,  and  on 
that  card  was  the  designation  of  participant  or  control."  The 
randomization  followed  administration  of  tests  and  screening  that 
determined  eligibility  and  individuals'  willingness  to  participate  in 
the  program. 

Failure  to  report  such  crucial  information  is  not  confined  to  the 
youth  employment  reports.  In  their  review  of  medical  research  journal 
articles,  such  as  the  New  England  Journal  of  Medicine,  for  example,  Der 
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Simmons  et  al.  found  that  only  one-fifth  reported  anything  on  m 
randomization. 


Statistical  Power  Analyses 

It  is  rare  for  final  reports  to  specify  the  probability  of 
program  effects,  if  indeed  they  exist,  given  the  sample  size  an 
design  parameters.  It  seems  especially  desirable  that  evaluati 
showing  "no  effects"  report  the  statistical  power  of  the  analys 
Even  when  effects  are  found,  the  power  calculations  should  be  a 
for  postevaluation  analyses,  e.g.,  was  the  size  of  effect  obtai 
close  to  the  effect  guessed  in  the  power  analysis. 


Costs 

Information  on  the  costs  of  an  evaluation,  apart  from  the  c 
the  program  under  examination,  is  almost  never  published  in  pro 
sional  journals  or  in  final  reports  of  evaluations.  In  consequ 
is  difficult  to  estimate  what  has  been  spent  on  evaluation  and 
impossible  to  do  good  benefit/cost  analyses  of  evaluations  base 
evidence.  There  is  no  readily  accessible  evidence. 

It  seems  desirable,  then,  to  have  information  on  costs  in  t 
report.  No  uniform  system  for  reporting  costs  of  elements  of  e 
has  been  adopted.  And  so  creation  of  alternative  accounting  sy 
for  budgets  and  expenditures  is  warranted. 


Graphs  and  Tables 

Tables  in  some  evaluation  reports  are  often  dreadful,  diffi 
understand,  and  impossible  to  read  quickly.  And  they  are  often 
ceptible  to  misreading.  Only  a  few  reports  on  youth  employment 
experiments  are  exceptional  on  this  account.  So,  for  example, 
printouts  of  tables  are  merely  reprinted,  rather  than  being  reo 
and  restructured  to  permit  the  reader  to  understand  patterns  qu 
The  state  of  the  art  in  constructing  tables  and  graphs  has 
remarkably  over  the  past  10  years.  It  is  a  shame  that  it  is  ig 
See  Pienberg  (1979)  and  Kruskal  (1980)  ,  among  others,  on  improv 
these  presentations. 
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APPENDIX 

D 

Estimates  of  Effects  of  Employment  and  Trainir 
Programs  Derived  from  National  Longitudinal 
Surveys  and  Continuous  Longitudinal  Manpower  1 

Valerie  Nelson  and  Charles  F.  Turner 


In  addition  to  the  program-specific  evaluations  of  YEDPA  e: 
tiveness  reviewed  in  Chapters  4  through  8,  several  evaluations 
used  large  representative  samples  of  the  American  population  t< 
estimates  of  the  overall  impact  of  all  federally  funded  employi 
training  programs.  The  most  prominently  used  data  bases  in  th< 
studies  are  the  Continuous  Longitudinal  Manpower  Survey  (CLMS, 
administered  by  Westat  with  data  collection  by  the  U.S.  Bureau 
Census) ,  and  a  special  youth  sample  of  the  National  Longitudin; 
(NLS ,  administered  by  the  Center  for  Human  Resource  Research  o: 
State  University  with  data  collection  by  the  National  Opinion  1 
Center — NORC) .  Both  of  these  surveys  involve  relatively  large 
(over  60,000  in  the  CLMS  and  over  12,000  in  the  NLS)  drawn  in  i 
designed  to  permit  generalizations  to  the  universe  of  American 
(NLS)  or  participants  in  CETA  programs  (CLMS)  .  (It  should  be  ] 
that  only  a  fraction  of  the  youths  in  the  NLS  sample  participa 
federally  funded  employment  and  training  programs,  and  similar: 
a  fraction  of  the  program  participants  sampled  in  the  CLMS  sur 
youths . ) 

While  the  major  charge  of  our  committee  was  to  focus  on  th< 
Employment  and  Demonstration  Projects  Act  (YEDPA)  knowledge  de' 
activities,  it  seemed  prudent  to  review  the  findings  from  stud 
these  other  data  bases.  Since  these  studies  use  data  gathered 
different  manner  and  have  a  somewhat  different  (and  wider)  foe 
provide  an  important  supplementary  perspective  on  the  substanc< 
problems  of  the  individual  YEDPA  evaluations  we  reviewed.  Mor 
because  these  studies  use  data  derived  from  samples  with  high 
coverage  rates  and  low  sample  attrition,  they  can  provide  a  mo 
adequate  evidentiary  basis  (at  least  in  respect  to  sampling  me 
than  many  of  the  other  studies  we  reviewed. 

There  are,  nonetheless,  important  limitations  to  these  dat 
as  well.  First,  they  are  not  targeted  on  specific  programs — a 
relevant  estimates  of  aggregate  program  effects  may  lump  toget 
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effective  and  ineffective  programs.  Second,  the  data  bases  (particu¬ 
larly  CLMS)  limit  the  extent  to  which  one  can  take  into  account  the 
effects  of  local  labor  market  conditions.  Third,  these  data  are  not 
derived  from  experiments  in  which  subjects  were  randomly  assigned  to 
take  part  in  a  program,  and  hence  the  resultant  estimates  of  program 
effectiveness  require  strong  assumptions  about  the  adequacy  of  the 
model  specification  and  the  matching  procedures  used  to  construct 
synthetic  "control"  groups.  Finally,  we  should  point  out  that  the  CLMS 
reports  were  provided  to  the  committee  in  "draft"  form  late  in  the 
course  of  our  work,  and  thus  our  evaluation  of  them  has  not  been  as 
intensive  as  that  of  the  individual  YEDPA  reports. 

In  the  following  pages  we  briefly  review  the  characteristics  of  the 
NLS  and  CLMS  data  bases.  We  then  describe  the  findings  of  empirical 
studies  which  have  used  these  data  bases  to  estimate  program  effective¬ 
ness.  We  conclude  by  discussing  the  most  serious  problem  with  all  of 
the  studies  (and  many  of  the  previously  reviewed  YEDPA  studies) : 
potential  biases  in  the  selection  of  a  "control"  group  of  nonprogram 
participants. 


CHARACTERISTICS  OF  CLMS  AND  NLS  DATA  BASES 

Both  the  CLMS  and  the  NLS  are  full  probability  samples  whose 
sampling  designs  appear  to  have  been  well  executed.  That  is  to  say, 
sample  coverage  appears  high  and  the  available  documentation  shows  that 
considerable  attention  was  given  to  important  methodological  details, 
such  as  adequacy  of  sampling  frame,  careful  screening  of  respondents  to 
ensure  that  they  fell  within  the  universe  being  sampled  from,  extensive 
follow-up  to  ensure  a  high  response  rate,  and  so  on. 

The  CLMS  was  designed  to  sample  all  persons  receiving  training  or 
employment  under  the  Comprehensive  Employment  and  Training  Act  (CETA) , 
and  of  course,  a  portion  of  that  sample  would  have  been  young  people. 
(The  CLMS  sample  of  program  participants  is  complemented  by  data  for 
nonparticipants  derived  from  the  Current  Population  Survey  (CPS).)  The 
NLS  youth  sample,  on  the  other  hand,  is  a  longitudinal  survey  of 
American  youths  begun  in  1979.  Because  it  sampled  the  entire 
population  of  young  persons  (and  indeed  over sampled  groups  who  were 
likely  to  participate  in  employment  and  training  programs) ,  it  does 
include  a  sample  of  young  persons  who  happened  to  have  participated  in 
YEDPA  or  CETA  programs. 


Sample  Execution 

Rough  lower  bounds  on  the  number  of  program  participants  aged  18-21 
in  each  sample  are  21,000  for  the  CLMS  and  1,800  for  the  NLS.  According 
to  information  provided  by  the  NLS  Data  Center  at  Ohio  State  University, 
the  NORC  sampling  report  for  NLS  surveys  (Frankel,  McWilliams,  and 
Spencer,  1983),  and  the  published  CLMS  estimates  (for  initial  waves  of 
data  collection) ,  it  appears  that  sample  attrition  rates  were  on  the 
order  of  .05  to  .10  per  wave  in  both  surveys.  Because  the  NLS  retained 
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in  the  sample  persons  who  did  not  respond  in  the  previous  wave  of  data 
collection,  it  is  said  that  each  of  the  1980-1983  waves  interviewed 
almost  .95  of  the  wave-1  sample.  The  CLMS,  in  contrast,  lost  about  .10 
of  its  sample  per  wave  and  did  not  retain  nonrespondents  from  previous 
waves.  Thus  by  wave  4,  it  obtained  interviews  with  only  .729  of  the 
wave-1  sample. 


Measurements 

To  the  extent  one  focuses  on  labor  force  outcomes  and  income  as 
dependent  variables  and  uses  standard  human  capital-type  variables 
(e.g.,  education,  training,  age),  either  data  base  might  be  of  value, 
although  the  lengthy  NLS  questionnaire  contains  a  much  wider  range  of 
social  and  economic  measures  than  does  the  CLMS.  (One  must  wonder, 
however,  about  the  extent  to  which  fatigue  may  contaminate  the  replies 
of  the  respondents  to  the  NLS.) 


Error  Structure 

The  reliability  and  validity  of  these  data  do  not  appear  (from  the 
available  documentation)  to  be  buttressed  by  explicit  estimates  of  the 
error  and  bias  introduced  by  respondents,  interviewers,  coders,  proces¬ 
sors,  and  so  on.  Since  the  Census  Bureau  has  a  routine  re-interview 
procedure,  some  test-retest  measurements  are  likely  available  for  the 
CLMS  data  set.  Information  on  other  aspects  of  the  error  and  bias  that 
affect  these  data  do  not  appear  to  be  available.  It  may  be  reasonable, 
however,  to  assume  that  an  error  profile  for  many  of  these  measurements 
might  be  similar  to  those  for  similar  measurements  made  in  other  surveys 
(see,  for  example.  Brooks  and  Bailar's  (1978)  error  profile  for  the  CPS 
labor  force  measurements).  Nonetheless,  the  fact  that  the  population 
of  interest  is  quite  unlike  a  cross-section  of  the  adult  population 
would  argue  for  caution  in  making  such  an  assumption. 


Time  Period  for  Evaluation 

If  we  assume  that  recall  and  other  errors  in  the  interview  data 
(and  processing  and  reporting  errors  in  Social  Security  earnings 
records)  are  not  too  troubling,  the  CLMS  data  provide  interview  data 
for  three  years  after  a  young  person  entered  a  program.  The  Social 
Security  earnings  records  extend  this  time  frame  even  further  (e.g., 
for  the  1975  program  entrants  we  may  have  earnings  in  1983)  . 

For  the  NLS  data  we  have  waves  of  data  covering  five  years  of 
actual  interviewing.  Since  the  NLS  obtained  retrospective  data  in  its 
initial  interview,  for  some  respondents  we  will  have  outcomes  that  were 
measured  more  than  five  years  after  participation  in  a  program. 
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General  Issues  of  Method1 

Despite  the  distinct  advantages  of  the  large  and  well-executed  CLMS 
and  NLS  samples,  there  are  several  serious  deficiencies  in  the  data. 
First  and  foremost,  neither  data  set  is  a  true  experimental  sample 
which  randomly  sorts  youths  into  participant  and  control  groups.  As  a 
result,  comparison  groups  must  be  constructed  by  a  "matching"  procedure 
using  demographic  variables  and  preprogram  earnings.  For  the  CLMS,  a 
comparison  group  was  drawn  from  Current  Population  Survey  data  and  for 
NLS,  a  comparison  group  was  drawn  from  nonparticipants  within  the 
sample  itself. 

However,  for  reasons  discussed  in  greater  detail  in  the  final 
section  of  this  appendix,  these  synthetic  "control"  groups  are  not 
entirely  adequate.  For  the  one  empirical  study  for  which  there  is 
explicit  evidence,  it  was  found  that  participants  appeared  to  be  more 
disadvantaged  than  nonparticipants  in  ways  that  could  not  be  "matched" 
with  the  available  data.  As  a  result  estimates  of  net  program  impact 
were  downwardly  biased. 

Information  on  several  key  variables  is  missing  in  one  or  another 
of  the  samples.  In  particular,  lack  of  location  data  in  the  CLMS  makes 
it  impossible  to  take  account  of  variations  across  local  labor  markets 
or  to  assess  the  site-specific  component  of  the  variance  in  outcomes. 
Furthermore,  the  matching  CPS  file  fails  to  record  either  participation 
in  CETA  or  subsequent  schooling.  These  deficiencies  can  lead  to  under¬ 
estimates  of  the  overall  impact  of  CETA  participation  (note  1) . 

Finally,  the  analyses  of  these  data  frequently  ignore  the  fact  that 
both  the  NLS  and  the  CLMS  have  complex  sample  designs.  The  variances 
for  estimates  derived  from  such  designs  can  differ  considerably  from 


xFor  the  CLMS  analyses,  further  problems  are  posed  by  deficiencies  in 
the  information  available  from  the  CPS  files  used  in  matching.  First, 
many  CPS  youths  will  have  been  enrolled  in  CETA  programs  themselves, 
but  neither  the  CPS  nor  the  accompanying  SSA  files  records  such  par¬ 
ticipation.  SRI  estimates  these  cumulative  probabilities  over  the 
period  of  1975  to  1978  to  be:  12.2  percent  for  adult  men,  14.9  percent 
for  adult  women,  31.1  percent  for  young  men,  and  30.7  percent  for  young 
women.  Second,  time  spent  in  school  is  not  recorded  for  the  CPS  sample 
during  the  postprogram  period.  As  a  result,  net  impacts  can  only  be 
estimated  for  earnings.  However,  if  CETA  graduates  are  more  likely 
than  others  to  seek  further  education,  this  will  also  tend  to  result  in 
lower  earnings  for  them  in  the  first  and  second  postprogram  years,  at 
least.  Not  only  will  a  negative  earnings  impact  be  accentuated,  but 
there  will  be  no  record  of  what  is  considered  an  additional,  positive 
impact  of  CETA,  that  is  a  return  to  school  on  the  part  of  dropouts  or 
other  highly  disadvantaged  groups.  The  Urban  Institute  has  found,  for 
example,  that  negative  findings  for  youths  in  classroom  training  may  be 
associated  with  their  increased  time  spent  in  school  in  postprogram 
years.  Such  data  limitations  thus  convey  an  overly  negative  impression 
of  the  impact  of  the  program. 
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those  estimated  using  simple  random  sample  (SRS)  formulas  (i.e.,  those 
produced  by  the  statistical  routines  of  the  most  widely  used  computer 
packages,  e.g.,  SPSSX,  SAS) . 

These  issues  are  discussed  in  greater  detail  below. 


FINDINGS  OF  STUDIES  USING  CLMS  DATA  BASE 

Three  studies  compare  CETA  participants  from  the  fiscal  1976  and 
fiscal  1977  Continuous  Longitudinal  Manpower  Surveys  with  comparison 
groups  selected  from  the  March  1976  or  March  1977  Current  Population 
Surveys.  These  studies  were  conducted  by  Westat  (1984) ,  SRI  Inter¬ 
national  (1984),  and  the  Urban  Institute  (Bassi  et  al.,  1984).  A 
fourth  study  conducted  by  Mathematica  Policy  Research  (Dickinson  et 
al.,  1984)  compares  net- impact  estimates  derived  from  such  CPS 
comparison  groups  with  those  from  a  true  experimental  comparison  of 
participants  and  controls  (using  data  from  the  Supported  Work 
demonstration  program) . 

The  first  three  CLMS  reports  differ  in  their  selection  of  CPS 
comparison  groups  and  in  the  analytic  models  used  for  net-impact 
estimation.  However,  their  findings  show  similar  patterns:  negative 
and  statistically  significant  (or  negligible)  net  impacts  on  post-CETA 
earnings  for  young  men  and  positive,  but  generally  insignificant  net 
impacts  for  young  women.  Only  on-the-job  training  seems  to  produce 
positive  gains  for  most  groups,  and  work  experience  is  universally 
negative  in  its  impact  on  earnings.  Among  the  studies,  the  Urban 
Institute  reported  the  greatest  negative  impacts  and  Westat  the  most 
positive;  the  SRI  results  were  in-between.  Again,  however,  it  is 
important  to  note  that  these  findings  may  be  biased  estimates  of  the 
true  impacts  of  CETA  on  youths  and,  as  such,  may  offer  an  inappropriate 
assessment  of  the  overall  program. 


Analysis  Strategies 

Each  of  the  three  CLMS-CETA  evaluations  used  three  data  sets:  (1) 
CETA  participants  selected  from  the  Continuous  Longitudinal  Manpower 
Survey  of  program  entrants  from  July  1,  1975,  to  June  30,  1976,  and/or 
from  July  1,  1976,  to  June  30,  1977  (Westat  also  conducted  some  pre¬ 
liminary  analysis  on  an  earlier  cohort);  (2)  nationally  representative 
samples  of  individuals  from  the  Current  Population  Survey  of  March  1976 
and/or  March  1977;  and  (3)  earnings  (up  to  the  Social  Security  tax 
limit)  for  both  CETA  participants  from  the  CLMS  and  individuals  selected 
from  the  CPS.  Net- impact  estimates  are  based  on  differences  in  prepro¬ 
gram  and  postprogram  earnings  between  the  CLMS-CETA  participants  and 
earnings  changes  for  similar  individuals  from  the  CPS  file. 

This  combination  of  data  appears  to  offer  many  distinct  advantages 
over  the  YEDPA  studies  discussed  in  Chapters  4  through  8.  The  samples 
are  large  and  nationally  representative  and  cover  several  years  of  CETA 
programs.  Annual  earnings  data  are  available  from  Social  Security 
Administration  (SSA)  files  from  1951  to  1979.  Comparable  data  are 
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available  on  all  major  programs  (classroom  training,  on-the-job 
training.  Public  Service  Employment,  and  work  experience)  for  the  same 
years  and  for  similar  economic  conditions.  Finally,  the  CLMS  file 
contains  detailed  data  on  participants  from  prime  sponsor  records, 
individual  interviews  at  entrance  into  CETA,  and  subsequent  interviews 
up  to  36  months  later.  For  these  reasons  and  others,  Westat  has  char¬ 
acterized  these  data  as  superior  to  any  data  set  that  has  previously 
been  available  for  evaluating  large  scale  federally  funded  employment 
and  training  programs. 

The  problems  of  net- impact  estimation,  however,  are  substantial  and 
arguments  for  one  method  or  another  have  been  a  central  focus  of  each 
of  the  three  major  studies  of  CETA  using  the  CLMS  data  base.  Because 
the  disagreements  are  often  sharply  drawn  and  because  they  result  in 
wide  variations  in  net- impact  estimates,  these  analytic  issues  are 
discussed  briefly  here.  No  attempt  is  made  to  resolve  disputes  in  one 
direction  or  another,  except  insofar  as  the  Supported  Work  evaluation 
provides  evidence  suggesting  bias  in  all  of  the  estimates  (see  final 
section  of  appendix) . 

Analytic  and  statistical  problems  fall  basically  into  three  main 
categories: 

1.  preliminary  screening  of  individuals  from  the  CLMS  and  CPS 
files  on  the  basis  of  missing  or  nonmatching  data,  termination  of 
program  participation  before  8  days,  and  similar  factors.  Such 
prematch  deletions  exclude  as  much  as  30  percent  of  the  original 
sample; 

2.  selection  of  a  comparison  sample  from  the  CPS  to  match  CETA 
participants  along  earnings-related  dimensions;  and 

3.  specification  of  a  linear  regression  (or  other)  model  of 
earnings  (and  accounting  for  "selection  bias") . 

Basically,  the  three  studies  may  be  distinguished  in  the  following 
ways:  Westat  devoted  substantial  resources  over  several  years  to 
creating  a  comparison  file  with  a  "cell  matching"  and  weighting  tech¬ 
nique,  but  ultimately  used  a  fairly  straightforward  regression  analysis 
to  estimate  net  impacts.  Using  these  methods,  net  impacts  for  youths 
were  generally  found  to  be  negligible  for  men  and  positive  for  women 
(few  precise  figures  for  youths  were  provided  in  their  study) .  SRI,  in 
a  subsequent  study,  focused  on  an  alternative  method  of  selecting  a 
comparison  file  using  a  Mahalonobis  or  "nearest-neighbor”  matching 
technique,  but  also  adopted  straightforward  regression  analysis  for 
most  of  its  estimates,  particularly  of  youths. 

For  all  the  attention  paid  by  both  Westat  and  SRI  to  the  selection 
of  the  comparison  group,  SRI  found  that  the  two  methods  produced 
similar  results,  all  else  held  equal.  The  more  negative  results 
presented  as  findings  of  the  SRI  study  stem  primarily  from  differences 
in  the  preliminary  screening  process  and  from  updating  of  earnings  with 
new  information  from  SSA.  (SRI's  net-impact  estimates  are  $591  for 
young  men  and  $185,  but  statistically  insignificant,  for  young  women.) 
Finally,  the  Urban  Institute  adopted  the  Westat  comparison  file  on 
youths  but  used  a  "fixed-effects"  estimator  to  control  for  bias  in 
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selecting  participants  into  CETA  and  reported  substantially  more 
negative  net  impacts  (a  range  of  -$515  to  -$1,303  for  young  men  and 
-$23  to  -$391,  but  statistically  insignificant,  for  young  women)  . 

It  appears,  therefore,  that  the  primary  differences  in  the 
net-impact  estimates  are  based  not  in  the  time-consuming  creation  of 
comparison  files,  but  in  the  preliminary  screening  of  the  CPS  and  CLMS 
files  and  in  the  specification  of  an  earnings  model.  The  Supported 
Work  study  by  Mathematica  provides  similar  evidence  that  the  particular 
procedure  used  to  select  a  comparison  sample  is  less  important  than  the 
net-impact  estimation  model  (a  fixed-effects  estimator  led  to  a  more 
negative  result  than  a  linear  model  of  postprogram  earnings)  . 

The  basic  goal  in  selecting  a  comparison  file  from  the  CPS  is  to 
find  a  group  of  individuals  who  closely  resemble  the  CETA  participants 
from  the  CLMS.  Lacking  a  true  (experimental)  control  group,  a  com¬ 
parison  group  procedure  is  a  next-best  approach  for  comparing  the 
earnings  and  employment  outcomes  of  those  who  participate  with  those 
who  do  not.  Net- impact  estimates  in  these  analyses  are  simply  the 
coefficient  on  program  participation  in  an  earnings  regression  that 
controls  for  background  characteristics  and  other  ear nings-r elated 
differences  in  a  composite  sample  of  youths  from  CLMS  and  CPS.2 

Three  basic  techniques  of  selecting  a  comparison  file  have  been 
used  in  these  studies: 

1.  random  sampling  of  CPS  cases  screened  only  for  program 
eligibility; 

2.  stratified  cell  matching  whereby  a  list  of  earnings-related 
variables  is  generated,  CLMS  participants  are  arrayed  across  cells  by 
these  variables,  and  CPS  cases  are  matched  and  weighted  to  produce  a 
similar  distribution  of  participants  and  nonparticipants.  Substantial 
"collapsing"  of  cells  is  required  since  the  number  of  cells  is  large 
even  for  a  small  list  of  variables;  and 

3.  statistical  matching  based  on  predicted  values  of  earnings  or 
the  "nearest  neighbor"  technique  of  minimizing  a  distance  function  of  e 
weighted  sum  of  differences  in  earnings-related  characteristics  of  the 
individual. 

Several  tests  of  the  "success"  of  the  CPS  match  are  available. 
These  are  similarity  in  demographic  or  background  characteristics 


2 If  earnings  functions  could  be  correctly  specified,  a  close  matching 
of  the  CLMS  and  CPS  data  files  would  not  be  so  important.  But  known 
nonlinearities,  interactions  of  variables,  and  other  complexities  of 
labor  market  behavior  across  the  population  at  large  make  impact 
estimates  from  a  simple,  linear  and  additive  model  highly  suspect. 
Breaking  down  the  files  into  subgroups  (as  by  sex  and  race  for  the 
Urban  Institute  and  by  sex  and  program  activity  for  Westat  and  SRI) 
would  handle  some  matching  of  youths  on  other  earnings-related 
characteristics  and  would  also  make  net- impact  estimation  more  precise 
for  the  range  of  people  who  are  likely  to  enroll  in  CETA. 
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(especially  those  variables  that  are  important  determinants  of 
earnings),  similarity  in  preprogram  earnings,  and  similarity  in 
preprogram  earnings  functions.  In  particular,  a  test  may  be  made  of 
whether  a  CETA  participation  dummy  variable  is  predictive  of  (or 
correlated  with)  a  preprogram  dip  in  earnings,  as  an  indicator  that 
program  administrators  may  be  "cr earning "  those  individuals  with  a 
temporary  drop  in  a  relatively  high  "permanent"  income  stream. 

A  fixed-effects  estimator  is  designed  to  control  for  such  creaming 
and  other  sample  selection  bias  by  "differencing"  a  base-year  and  a 
postprogram  year  earnings  equation.  Any  unobserved  characteristics 
that  lead  to  participation  in  CETA,  but  also  affect  earnings,  are 
assumed  to  be  constant  over  time  and  can  be  accounted  for  in  such  a 
procedure.  If  there  is  creaming  based  on  a  transitory  preprogram  drop 
in  income,  then  the  base-year  must  be  chosen  a  year  or  two  earlier  to 
reflect  a  more  permanent  income  trend. 

In  the  majority  of  cases  in  the  three  reports,  the  CPS  comparison 
groups  pass  the  tests  of  similarity  to  CLMS/CETA  participants.  For 
example,  as  a  result  of  cell  matching  or  nearest-neighbor  matching,  the 
CPS  pool  is  winnowed  from  a  largely  white  sample  of  in-school  youths  or 
high  school  graduates  from  families  above  the  poverty  level  to  a  mixed 
black/white  sample  that  includes  large  numbers  of  high  school  dropouts 
from  families  below  the  poverty  line.  The  comparison  groups  also 
resemble  CETA  participants  in  preprogram  earnings.  Matching  on  such 
background  characteristics  and  preprogram  earnings,  of  course,  does  not 
necessarily  equalize  unmeasured  characteristics  (e.g.,  actual  or 
perceived  motivation,  ability) — a  point  to  which  we  shall  return. 


Westat  Findings 

In  1980,  Westat  began  to  release  a  series  of  net- impact  studies 
based  on  CLMS  and  CPS  data.  Comparison  groups  were  created  using 
stratified  cell-matching  techniques  for  CETA  entrants  in  the  first  half 
of  1975,  and  for  fiscal  1976  and  1977.  Cells  were  defined  by  such 
variables  as  age,  race,  sex,  family  income,  and  education.  Two  basic 
matching  subdivisions  were  made:  one  divided  the  CLMS  sample  into  low, 
intermediate,  and  high  earners  and  constructed  separate  CPS  comparison 
file  for  each,  and  a  second  divided  the  program  activities  into: 
classroom  training,  on-the-job  training,  public  service  employment, 
work  experience,  and  multiple  activities.  Because  the  latter  match  was 
more  "successful"  in  terms  of  passing  statistical  tests  of  similarity 
between  groups,  it  was  used  in  most  of  the  later  Westat  studies.  Net 
impacts  were  estimated  for  three  post-CETA  years  for  the  fiscal  1976 
group  and  for  two  years  for  the  fiscal  1977  group. 

Westat's  (1984)  report  summarizes  their  findings  over  the  last 
several  years.  Although  the  report  presents  very  few  specific  results 
for  young  men  and  women,  its  overall  conclusions  for  adults  are  of 
interest.  Key  findings  are  the  following: 

•  Statistically  significant  positive  impacts  for  both  cohorts 
and  all  postprogram  years;  estimates  ranged  from  a  low  of  $129  per  year 
to  a  high  of  $677; 
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•  Among  programs,  classroom  training  and  on-the-job  training 
show  the  highest  net  impacts  and  work  experience  the  lowest;  these  rar 
orders  are  relatively  stable  across  cohorts  and  postprogram  years; 

8  For  the  first  cohort,  there  was  a  marked  difference  in  net 
impacts  by  sex — males  experienced  statistically  insignificant  gains  ar 
females  experienced  significant  gains; 

8  For  the  second  cohort,  however,  net  impacts  converged  for  men 
and  women  at  statistically  significant  levels; 

*  Higher  net  impacts  for  low  earners  (less  than  $2,000  in  1972 
and  1973)  than  for  high  earners; 

8  Positive  gains  from  "placement"  in  a  job  at  termination  and 
increasing  gains  with  length  of  stay  in  the  program; 

8  Substantially  higher  net  impacts  for  the  second  cohort  than 
for  the  first;  these  are  attributed  to  a  dramatic  increase  in  net 
impacts  for  men,  a  decline  in  the  proportion  of  youths  with  work 
experience,  and  across-the-board  increases  in  all  programs. 

Specifically  for  youths,  Wes tat  found, 

8  Youth  work  experience  programs  are  statistically  insignificant 
for  all  cohorts  and  postprogram  years. 

Other  specific  youth-related  findings  are  not  reported  in  Westat 
(1984),  but  the  Urban  Institute  has  characterized  Westat's  results  frc 
earlier  reports,  as  follows: 

In  looking  at  youth,  Westat  (1982)  has  found  that  for  those 
youngsters  14  to  15  years  old,  CETA  has  had  little  overall 
impact.  For  other  young  workers  net  gains  are  found,  being 
highest  once  again  for  OJT,  followed  by  PSE  and  classroom 
training,  and  being  negligible  for  work  experience.  The 
results  found  for  young  workers  also  tend  to  persist  in  the 
second  postprogram  year.  Westat  also  produced  a  technical 
paper  focusing  on  youth  in  CETA  (1981)  in  which  net  gains  were 
broken  down  by  sex.  As  with  adults,  net  gains  were  greatest 
for  young  females,  being  negligible  or  insignificant  for 
males.  After  classifying  youth  according  to  their  attachment 
to  the  labor  force,  net  earnings  gains  were  found  to  be 
greatest  among  structurally  unemployed  or  discouraged 
workers. 


SRI  Findings 

SRI's  analysis  differs  from  Westat's  in  two  key  respects:  in  the 
selection  of  the  comparison  group  and  in  its  "sampling  frame."  SRI's 
comparison  groups  were  drawn  by  use  of  a  "nearest-neighbor"  matching 
procedure  based  on  minimizing  the  "distance"  of  CLMS  participants  and 

ed  anforl  PUO  r\  r«  ti  1  _ vnl  v  i  -sUI  Pht  I  a  a  *  « 


TABLE  D.l  SRI  Estimates  of  Net  Impact  of  CETA 
on  SSA  Earnings  (Standard  Errors  in 
Parentheses) 


Subgroup 

SSA  Earnings 
(dollar  impacts) 

Adult  men 

-690 

(N=6 ,144 ) 

(139) 

Adult  women 

13 

(N=5,438) 

(116) 

Young  men 

-591 

(N=3 ,298) 

(167) 

Young  women 

185 

(N=2 ,826) 

(139) 

NOTE:  Published  standard  errors  for  estimates 
appear  in  parentheses  but  are  likely  to  be 
inaccurate;  see  note  5. 

SOURCE:  SRI  International  (1984)  . 


inclusion  (versus  Westat  exclusion)  of  individuals  who  received  only 
"direct  referrals"  among  those  who  received  fewer  than  eight  days  of 
treatment;  SRI  exclusion  (versus  Westat  inclusion)  of  individuals  who 
worked  in  1975  but  were  out  of  the  labor  force  in  March  1976;  and  use 
of  a  different  set  of  rules  for  excluding  individuals  if  key  CPS  or 
CLMS  codes  did  not  match  their  SSA  codes. 

SRI's  model  differed  from  Westat' s  only  in  the  addition  of  several 
variables,  such  as  veteran  status  and  earlier  earnings  and  the  square 
of  1975  SSA  earnings.  (Table  D.l  presents  SRI  estimates  of  net  impacts 
of  CETA  on  earnings  for  all  participants  in  1978.)  SRI  also  experi¬ 
mented  with  fixed-effects  estimators  for  adult  men  and  women,  but 
argued  that  they  were  not  appropriate  for  youths  just  beginning  work. 

SRI's  estimates  of  program  effects  were  substantially  below  Westat' 
for  both  adults  and  youths,  and  the  authors  spent  considerable  time  in 
identifying  the  sources  of  those  differences.  From  their  analyses,  the 
SRI  authors  concluded  that  most  of  the  differences  could  be  attributed 
to  choices  made  in  the  sampling  frame  and  to  an  updating  of  1979  SSA 
earnings.3 


3 Net  impacts  were  minimally  sensitive  to  the  estimation  model  or  to 
the  matching  technique  used. 


SRI  (1984)  reported  the  following  findings  for  1976  CETA  ei 

•  Participation  in  CETA  results  in  significantly  lower  poi 
gram  earnings  for  adult  men  (-$690)  and  young  men  (-$591)  and 
statistically  insignificant  gains  for  adult  women  (+$13)  and  y< 
women  (+$185) . 

•  All  program  activities  have  negative  impacts  for  men,  bi 
adult  women  benefit  from  PSE  and  young  women  from  OJT.  Work  ex] 
have  negative  impacts  for  all  age  and  sex  subgroups . 

•  Both  male  and  female  participants  are  more  likely  to  be 
employed  after  CETA,  but  males  are  less  likely  to  be  in  high-p. 
jobs  or  to  work  long  hours. 

•  Length  of  stay  in  the  program  has  a  positive  impact  on 
postprogram  earnings;  turning  points  for  young  men  are  at  8  moi 
for  young  women  at  1  month. 

•  Placement  on  leaving  the  program  leads  to  positive  earn 
gains. 


Urban  Institute  Findings 

The  Urban  institute  used  Westat's  match  groups  from  the  CP! 
estimated  net  impacts  for  six  race/sex  groups  (male/female  by  i 
black/Hispanic)  .  Both  random-effects  estimators  and  fixed-eff< 
estimators  were  used  to  identify  net  impacts,  but  the  emphasis 
fixed-effects  models  which  controlled  for  selection  bias.  Net 
were  estimated  for  two  postprogram  years,  1978  and  1979.  (Tab 
presents  net  impacts  estimated  in  the  Urban  Institute  analysis 

The  Urban  Institute  (Bassi,  et  al.,  1984)  found,  for  youth 

•  Significant  earnings  losses  for  young  men  of  all  races  , 
significant  impacts  for  young  women;  these  impacts  persist  int< 
second  postprogram  year; 

•  Significant  positive  net  impacts  for  young  women,  parti' 
minorities  in  Public  Service  Employment  and  on-the-job  trainin' 
significant  negative  or  insignificant  net  impacts  for  all  grou] 
work  experience; 

•  Among  subgroups,  the  most  negative  findings  were  for  wh 
males,  the  most  positive  for  minority  females; 

•  Older  youths  (22-year-olds)  and  those  who  had  worked  lei 
quarter  time  had  stronger  gains  or  smaller  losses  than  the  you: 
group  or  those  who  had  worked  quarter  time  or  more; 

•  Earnings  gains  resulted  primarily  from  increased  time  i 
labor  force,  time  employed,  and  hours  worked,  rather  than  from 
increased  average  hourly  wages. 


FINDINGS  OF  STUDIES  USING  NLS  DATA  BASE 

Two  major  studies  have  used  the  National  Longitudinal  Surv 
base  to  estimate  the  aggregate  effects  of  government-sponsored 
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TABLE  D.2  Urban  Institute  Estimates  of  Net  Impact  of  CETA  Participation 
on  Earnings  of  Youths  Under  Age  23,  for  Three  Models 


1978 

1979 

Race/Sex  Group 

REa 

FE-75a 

FE-74a 

REa 

FE-75a 

FE-74a 

White  females 

-  109 

-  23 

-  68 

-  190 

-  92 

-  136 

(.930) 

(.194) 

(0.57) 

(1.33) 

(0.62) 

(0.92) 

Black  females 

-  201 

-  77 

-  159 

24 

170 

88 

(0.89) 

(0.34) 

(0.71) 

(0.09) 

(0.61) 

(0.32) 

Hispanic  females 

-  391 

-  261 

-  231 

-  501 

-  348 

-  318 

(1.10) 

(.716) 

(0.64) 

(1.14) 

(0.79) 

(0.71) 

White  males 

-  593 

-  515 

-  576 

-  795 

-  728 

-  789 

(4.23) 

(3.73) 

(4.12) 

(4.47) 

(4.11) 

(4.43) 

Black  males 

-  989 

-  681 

-  758 

-1167 

-  748 

-  822 

(3.67) 

(2.57) 

(2.85) 

(3.42) 

(2.16) 

(2.38) 

Hispanic  males 

-1155 

-1193 

-1303 

-1009 

-1080 

-1190 

(2.56) 

(2.61) 

(2.82) 

(1.78) 

(1.89) 

(2.07) 

NOTES:  Coefficients 

represent 

dollar  impacts  on  social 

security 

earnings 

. 

Published  t  statistics  are  in  parentheses,  but  are  likely  to  be  inaccurate; 
see  note  5. 


aModels:  RE — random  effects;  FE-75 — fixed  effects,  base  period  1975;  and 
FE-74 — fixed  effects,  base  period  1974. 

SOURCE:  Bassi  et  al.  (1984). 


ment  and  training  programs  on  youths.  One  study  (Moeller  et  al.,  1983) 
was  conducted  by  the  Policy  Research  Group  (PRG)  of  Washington,  D.C., 
and  the  other  (Hahn  and  Lerman,  1983)  by  the  Center  for  Employment  and 
Income  Studies  (CEIS)  of  Brandeis  University.  Both  studies  evaluated 
the  effects  of  CETA  programs  on  youths,  although  the  PRG  study  expanded 
its  scope  to  include  schooling  programs,  such  as  vocational  education. 

The  estimates  made  by  both  studies  indicate  relatively  modest 
effects  of  employment  and  training  programs  on  the  subsequent  income, 
employment  status,  and  educational  attainment  of  the  youths  who 
participated  in  those  programs.  For  CETA  programs  both  studies  find 
negative  overall  effects  of  CETA  on  employment,  although  PRG  reports 
some  positive  effects  at  two  years  after  CETA  completion.  Reviewing 
PRG  results  and  their  own  findings,  the  CEIS  authors  (Hahn  and  Lerman, 
1983:84)  dourly  conclude  an  appendix  to  their  chapter  entitled  "Did  the 
CETA  System  Work  for  Disadvantaged  Youth?"  by  noting: 

To  conclude,  both  the  PRG  results  and  our  own  show  negative  and 
significant  effects  of  CETA  on  employment  variables.  It  is 
only  after  going  out  two  years  in  time  after  CETA  completion 
that  the  PRG  report  finds  evidence  of  a  positive,  significant 
effect  and  that  on  only  one  variable,  unsubsidized  earnings. 


Since  the  substantive  findings  from  the  NLS  analyses  are  genera 
consistent  with  the  weak  and  generally  negative  findings  from  t 
analyses  we  do  not  review  them  in  great  detail.  Instead,  we  br 
describe  the  analysis  strategies  and  findings  of  each  of  the  st 
then  turn  to  a  consideration  of  the  potential  for  bias  introduc 
use  of  statistical  matching  procedures  rather  than  random  assig 
construct  "control"  groups  in  the  CLMS  and  NLS  analyses. 


CEIS  Procedures  and  Findings 

The  analysis  reported  by  Hahn  and  Lerman  (1983)  employs  a  n 
neighbor  matching  procedure1*  to  construct  a  "matched"  control  g 
to  be  compared  with  the  1,114  respondents  in  the  NLS  youth  samp 
reported  participating  in  CETA  programs.  (The  matched  sample  w 
constructed  by  selecting  respondents  from  among  the  4,608  NLS 
respondents  who  reported  that  they  had  not  participated  in  a  CE 
program  and  who  were  neither  in  the  military  nor  had  family  inc 
above  325,000  in  1978,  and  who  did  respond  to  the  questions  use 
construct  the  eight  matching  variables.) 

The  variables  used  for  matching  were:  sex,  race,  age,  famil 
family  income  (in  1978),  weeks  employed  (in  1978),  whether  the 
was  living  at  home,  and  whether  the  youth  was  a  high  school  dro 
All  the  matching  variables  were  derived  from  the  1979  survey, 
resulting  "matched"  sample  was  then  used  to  estimate  the  impact 
(prior)  participation  in  CETA  programs  on  earnings  and  employme 
1979  and  later  years.  As  with  the  CLMS  matchings,  the  CEIS  ana 
the  NLS  data  base  takes  a  pool  of  largely  white,  middle-class  y 
and  produces  a  "matched"  sample  which  is  65  percent  black  and  h 
mean  family  income  of  $8,790  (in  1978). 

The  CEIS  analysis  concentrates  initially  on  employment  in  u 
sidized  jobs  as  its  major  outcome  measure.  The  authors  argue  t 
is  the  appropriate  outcome  measurement  for  initial  study  since 
"politically  the  motivating  concern  in  establishing  a  CETA  proc 
to  increase  the  likelihood  that  disadvantaged  youths  could  find 
employment  in  the  regular  (i.e.,  non-CETA)  labor  market.  Their 
analysis  derives  an  estimate  of  program  effects  for  a  regressic 
that  incorporates  20  other  independent  variables. 

The  coefficients  estimated  in  this  analysis  are  reproduced 
D . 3  together  with  the  published  t-ratios.  (The  latter  statist] 
appear  to  ignore  the  complex  sampling  design  used  in  the  NLS  an 


4Hahn  and  Lerman  (1983:75)  used  a  "nearest  available  Mahalonobi 
metric  matching"  method  suggested  by  Rubin  (1979). 


are  likely  to  be  inaccurate.5)  It  will  be  seen  from  Table  D.3  that 
the  net-impact  estimates  derived  from  this  analysis  are  quite  negative, 

(text  is  continued  on  p.  269) 


5 A  complete  assessment  of  the  variance  and  bias  components  of 
estimates  derived  from  surveys  of  complex  design  requires  an  assessment 
of  effects  arising  from  sample  design,  interviewer  contributions  to  the 
variance,  and  the  effects  of  sampling  frame  bias  and  nonresponse,  among 
other  factors.  These  variance  components  in  survey  estimates  are 
typically  referred  to  as  "design  effects." 

It  is  often  the  case  that  the  secondary  analyst  lacks  sufficient 
information  (coded  into  the  sample  data)  to  make  adequate  assessments 
of  such  components  of  the  variation  in  his  or  her  estimates.  In  the 
NLS  (and  many  other  surveys  conducted  by  quality-conscious  research 
organizations) ,  information  is  available  concerning  the  sample  design 
used  in  the  survey  (see  Frankel  et  al.,  1982). 

Like  many  large-scale  household  surveys,  the  NLS  used  a  multistage 
area  probability  sample  with  sample  clustering  at  the  block  level.  For 
reasons  of  cost  and  efficiency,  self-weighting  simple  random  samples 
(SRS)  are  seldom  used  in  such  large-scale  surveys.  Rather,  sample 
designs  incorporate  a  multi-stage  selection  process  and  some  type  of 
sample  clustering.  Instead  of  a  random  draw  of  individuals,  small 
geographical  areas  (e.g.,  blocks  in  cities)  are  sampled,  and  then  a 
number  of  individuals  in  that  area  are  selected  for  interview.  This 
group  of  individuals  is  referred  to  as  a  sample  cluster.  Cluster  sizes 
of  5  to  10  individuals  per  "block"  are  common  in  national  surveys.  In 
personal  interview  surveys,  such  sample  clustering  is  a  practical 
necessity,  since  any  random  draw  of  subjects  in  a  national  survey  might 
require  some  interviewers  to  travel  hundreds  of  miles  between 
successive  interviews. 

Because  a  sample  of,  say  5,000,  may  thus  consist  of  500  randomly 
selected  "blocks,"  from  which  10  individuals  were  selected,  the 
variances  of  both  univariate  and  multivariate  statistics  are  not 
accurately  portrayed  by  the  well-known  formulas  that  apply  to  simple 
random  samples.  This  is  so  because  the  sampling  of  individuals  was  not 
independent  of  their  location.  To  the  extent  that  individuals  within  a 
selected  location  are  homogeneous  with  respect  to  a  given  measurement, 
the  effect  of  the  use  of  a  clustered  sample  is  to  increase  the  variance 
of  the  estimates  (above  those  that  obtain  for  SRS  designs) — or,  to 
express  it  another  way,  to  decrease  the  effective  sample  size  from  the 
number  of  individuals  (%)  toward  the  number  of  locations  that  were 
chosen  (Nc) .  In  extreme  cases,  e.g.,  the  use  of  such  samples  to 
estimate  the  distribution  of  the  population  across  (self-perceived) 
rural  versus  nonrural  areas,  the  effective  sample  size  may  approach 
Nc  since  almost  all  of  the  extant  variation  occurs  between  rather 
than  within  sample  clusters — and  hence  we  have  a  sample  of  Nc 
clusters,  where  almost  all  of  the  respondents  in  any  one  cluster 
give  the  same  response  when  asked  whether  they  live  in  a  rural  area. 
Another  way  of  expressing  this  result  is  to  say  that  the  intra-cluster 
correlation  of  response  approaches  1.0  for  this  variable.  For  more 
rigorous  theoretical  treatments  of  this  matter,  see  Hansen  et  al. 

(Footnote  5  is  continued  on  pp.  268-269) 
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(1953)  or  Kish  (1965)  ;  for  an  elementary  introduction,  see  Blalock 
(1972:520-530) . 

Of  course,  residence  in  a  rural  area  is  an  extreme  case,  but  high 
intracluster  correlations  arise  for  many  other  variables  of  interest. 
The  type  of  dwelling  unit  (apartment  versus  house)  has  similar 
characteristics,  and  even  such  crucial  variables  as  race  and  income 
show  relatively  high  intra-cluster  correlations  in  sample  surveys  as  c 
result  of  the  residential  segregation  of  neighborhoods.  (Persons  of 
the  same  race,  income,  and  so  on  tend  to  live  together.) 

This  has  important  practical  implications  for  the  survey  analyst 
since  the  widely  used  algorithms  for  computing  variances  for  simple 
random  samples  (e.g.,  those  of  the  SPSSX,  SAS,  and  BMD  computer 
packages)  are  not  appropriate.  Use  of  SRS  formulas  to  calculate  the 
sampling  variances  from  commonly  used  cluster  designs  may  considerably 
understate  standard  errors  for  means,  regression  coefficients,  and  so 
on.  Since  variances  and  their  roots  figure  crucially  in  all 
inferential  statistics,  serious  errors  of  inference  can  be  made. 

Design  effects  (deff)  that  arise  from  the  use  of  complex  sample 
designs  are  commonly  expressed  (see  Kish,  1965:258ff)  as  the  ratio  of 
the  actual  variance  of  a  sample  estimate  to  the  variance  of  an  SRS 
sample  of  equal  size.  The  square  root  of  the  deff  ratio  (which  is 
referred  to  as  deft)  can  be  used  to  "deflate"  statistics  derived  undei 
SRS  assumptions.  For  example,  in  the  case  of  the  t-statistic: 

deft  =  (deff)0*5 
^true  =  t-sr 

A  careful  study  (Frankel,  1971)  of  design  effects  for  eight  variables 
in  the  Current  Population  Survey  found  values  of  deft  that  ranged  fror 
1.1  to  1.5.  (The  variables  studied  were  number  of  persons  in 
household,  number  aged  0-17,  number  in  labor  force,  household  income, 
and,  for  the  "head  of  household,"  income,  age,  sex,  and  educational 
attainment.)  In  discussing  the  practical  importance  of  such  studies, 
Frankel  (1971:1-2)  observed: 

As  social  scientists  become  more  mathematically  sophisticated 
and  attempt  to  use  sample  survey  data  to  uncover  multivariate 
relationships,  the  gap  between  the  assumptions  of  existing 
statistical  theories  and  the  actuality  of  sample  designs  used 
to  collect  data,  make  the  valid  use  of  standard  inferential 
techniques  tenuous.  Naive  researchers  may  be  unaware  of  this 
gap  and  may  use  inference  which  assumes  that  their  sample  is  a 
simple  random  selection  of  elements.  However,  more  sophis¬ 
ticated  social  scientists  are  faced  with  the  task  of  making 
statements  like  that  of  Blau  and  Duncan  in  their  study.  The 
American  Occupational  Structure:  "We  do  not  know,  however,  how 
other  statistics,  such  as  regression  coefficients  .  .  .  and 
F”tatios,  are  affected  by  the  departure  of  the  sampling  design 
from  simple  random  sampling.  Only  very  rough  guesses  about 
standard  errors  can  be  made.  ..." 


e.g.,  -$1,640  in  1980  earnings  (from  unsubsidized  employment).  The 
CEIS  study  further  examines  some  of  these  outcomes  for  particular 
population  subgroups  and  youth  participating  exclusively  in  "skills 
training"  programs.  With  a  few  modest  exceptions,  however,  these 
analyses  lead  the  authors  to  similar  conclusions,  i.e.,  no  (positive) 
net  impact  of  CETA  participation. 

While  these  analyses  share  many  characteristics  with  the  CLMS 
analyses  (and  share  the  potential  for  "matching  bias"  that  is  discussed 
in  the  final  section  of  this  appendix) ,  they  do  have  unique  aspects 
that  should  be  noted.  A  critical  one  is  their  reliance  on  respondents' 
self-reports  of  whether  they  participated  in  CETA.6  Although  no 
estimates  of  the  error  and  bias  components  of  these  measurements  are 
proffered,  it  is  unlikely  that  these  crucial  variables  will  be  reported 
without  error.  Also,  in  contrast  to  the  SSA  records  used  in  the  CLMS 
analyses,  the  CEIS  study  must  rely  on  the  self-reports  of  earnings  in 
the  NLS — and  indeed  must  then  use  other  self-reports  to  characterize 
those  earnings  as  "subsidized"  or  "unsubsidized."  Here,  again,  the 
potential  for  inaccuracies  in  such  reports  (involving  both  random  and 
systematic  errors)  could  potentially  affect  the  outcomes  obtained  in 
the  CEIS  analysis. 


Frankel's  (1971)  findings  suggest  that  standard  errors  for  his  eight 
variables  would  be  understated  by  about  10  to  50  percent  if  SRS 
formulas  were  used  (with  the  larger  numbers  applying  to  multiple 
correlation  statistics,  the  smaller  to  multiple  regression 
coefficients,  and  means  and  simple  correlations  resting  in  the 
middle).  He  has,  however,  no  available  data  for  race,  which  is  quite 
highly  clustered  geographically  (racial  discrimination  and  other 
factors  produced  a  very  nonrandom  distribution  of  blacks  and  whites 
across  "blocks"  and  neighborhoods  in  the  United  States) .  Statistical 
research  on  health  surveys  (Landis  et  al.,  1982)  indicates  that  defts 
in  excess  of  2.0  occur  for  such  things  as  the  partial  regression 
coefficient  representing  the  "effect"  of  race  on  health  conditions 
(e.g.,  standard  errors  for  the  "effects"  of  race  on  number  of  decayed 
teeth,  net  of  age,  sex,  and  consumption  of  sugar,  may  be  underestimated 
by  a  factor  of  2  or  more  if  SRS  formulas  are  used) .  It  is  difficult  to 
assess  what  analogous  values  might  be  in  earnings  equations,  but 
caution  is  clearly  advisable  in  interpreting  the  estimates  provided  by 
the  CEIS  and  PRG  analyses. 

®CLMS,  in  contrast,  sampled  participants  from  lists  using 
administrative  records  (from  prime  sponsors) .  The  CPS  match  samples 
used  in  the  CLMS  studies  are,  however,  subject  to  similar  but  even  more 
severe  concerns.  It  is  not  possible  to  identify  "program  participants" 
in  the  CPS  match  sample,  and  thus  the  CLMS  analyses  must  contrast  a 
sample  of  individuals  who  all  participated  in  CETA  with  a  cross- 
sectional  sample  containing  both  participants  and  nonparticipants. 
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TABLE  D.3  CEIS  Estimates  of  Net  Impact  of 
Participation  in  CETA  on  Unsubsidized  Net 
Earnings  (in  dollars  per  year) 


Independent  Variables 

Unsubsidized 

1979 

Earnings 

1980 

Participation  in  CETA 

-675.9 

-1640.2 

(-3.92) 

(-7.54) 

Reservation  wage 

661.4 

980.8 

(5.4) 

(6.28) 

Has  child 

142.7 

130.3 

(0.45) 

(0.31) 

White 

-74.7 

17.3 

(-0.37) 

(.07) 

Has  illicit  income 

9.5 

-57.8 

(.04) 

(0.20) 

Rotter  scale 

65.7 

-70.2 

(locus  of  control) 

(0.90) 

(-0.70) 

Family  income  1978 

.047 

0.060 

(3.56) 

(3.48) 

Area  unemployment 

-22.0 

27.14 

rate  1979 

(-0.61) 

(0.60) 

Weeks  employed  1978 

57.2 

49.85 

(10.97) 

(7.43) 

High  school  dropout 

234.7 

-525.0 

1979  interview  date 

(0.92) 

(-1.59) 

Female 

-867.3 

-1077.4 

(-4.51) 

(-4.32) 

Family  size 

-148.0 

-160.7 

(-3.49) 

(-2.88) 

Knowledge-of-world-of- 

11.8 

14.2 

work  scale 

(0.23) 

(0.21) 

Numerical  operations 

88.0 

55.4 

standard  score 

(0.77) 

(0.37) 

Age  at  1979  interview 

287.8 

407.9 

(4.44) 

(4.81) 

Mechanical  comprehension 

-79.8 

-140.9 

(-0.56) 

(-0.78) 

Does  not  live  at  home 

-23.1 

-537.4 

(-0.08) 

(-1.44) 

Paragraph  comprehension 

137.1 

-95.7 

standard  score 

(0.95) 

(-.50) 

Math  knowledge  standard 

-242.3 

-327.2 

score 

(-1.48) 

(-1.55) 

Word  knowledge  standard 

-98.7 

-139.0 

score 

(-0.62) 

(-0.68) 

Arithmetic  comprehension 

250.3 

368.8 

scale 

(1.34) 

(1.54) 

Constant 

-3908.8 

-4456.9 

(-3.38) 

(-2.92) 

k2 

.24 

.22 

N 

1266 

1120 

NOTE:  Published  t  statistics  appear  in  parentheses 


PRG  Procedures  and  Findings 

While  the  PRG  analyses  differ  in  their  details  from  those  of  CEIS, 
.he  basic  strategy  was  the  same.  PRG  used  the  NLS  youth  sample  to  (1) 
.dentify  all  participants  in  government  employment  and  training  pro¬ 
rams,  (2)  construct  a  comparison  group  of  nonparticipants,  and  (3) 
jstimate  a  model  for  the  outcome  variables  of  interest.  The  PRG 
inalysis  of  the  NLS  data  base  differs  from  CEIS's  in  its  use  of  a  wider 
ange  of  outcome  measures  (including  earnings,  employment,  educational, 
ind  marital  outcomes)  and  a  somewhat  different  strategy  for  constructing 
t  comparison  group  of  nonparticipants. 

PRG  used  what  it  described  as  a  "stratified  random  sampling 
>rocedure"  to  select  the  comparison  group,  but  the  description  of  this 
>rocedure  is  unclear  in  some  respects.  The  authors'  (Moeller  et  al.» 
.983:E-1)  "overview"  of  the  procedure  is  stated  as  follows:7 

Both  the  CEIS  (1982)  and  Westat  (1980)  studies  .  .  .  adopted  a 
"match"  procedure  for  selecting  a  control  group  (hereafter 
referred  to  as  the  CGRP) .  We  instead  chose  to  use  a  stratified 
random  sampling  procedure  for  its  computational  advantages  and 
sound  statistical  approach  to  selecting  the  CGRP  sample,  in 
combination  with  a  reasonably  complete  control  variable 
specification  in  the  outcome  regressions,  weights  for  the  two 
samples  to  equate  the  number  of  participant  and  comparison 
group  members  within  each  stratification  cell,  and  a 
selectivity  bias  correction  for  "unmeasured"  differences 
between  the  participant  and  CGRP  members,  we  did  not  judge  the 
additional  computational  burden  of  a  match  procedure  to  be 
warranted. 

Ct  appears  that  this  procedure  involved  the  construction  of  a  synthetic 
rariable  representing  the  socioeconomic  status  (SES)  of  the  respondent 
ind  then  cross-classifying  participants  and  nonparticipants  by  SES, 

>ex,  race,  local  unemployment  rate,  region.  Prior  to  the  cross- 
classification,  each  of  these  variables  was  dichotomized  (e.g.,  local 
memployment:  0-5  percent  versus  6  percent  or  more) ,  except  for  region, 
</hich  had  four  categories.  Nonparticipants  were  then  selected  at 
random  from  within  the  resulting  128  cells  with  the  probability  of 


'This  text  is  an  accurate  reproduction  of  the  PRG  statement  (the 
original  is  also  garbled) .  It  should  be  noted,  too,  that  the 
'selectivity  bias  correction"  analysis  was  not  included  in  the  PRG 
report,  and  according  to  statements  elsewhere  in  the  report  these 
inalyses  were  not  performed. 
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selection  for  each  cell  being  equal  to  the  proportion  of  the 
participant  sample  that  fell  into  the  same  cell.8 

Two  aspects  of  the  PRG  analysis  are  troubling.  First,  the  authors 
used  an  ordinary  least  squares  procedure  to  estimate  their  model 
equations  where  some  of  their  dependent  variables  take  only  two  values 
(e.g.,  0:  out  of  school.  Is  in  school).  This,  in  addition  to  use  of 
procedures  that  assume  simple  random  sampling,  raises  doubts  about  the 
accuracy  of  the  reported  significance  levels.  On  a  more  substantive 
level,  we  note  that  the  authors  never  combine  their  separate  analyses 
of  employment  status  and  education,  and  so  we  cannot  tell  to  what 
extent  the  decreased  earnings  of  CETA  participants  might  be  due  to  the 
increased  enrollments  in  school.  If  this  were  to  account  for  an 
important  share  of  the  observed  income  drop,  one  might  characterize  the 
earnings  decline  as  an  investment  of  foregone  earnings  in  education 
rather  than  a  negative  outcome  of  CETA. 

Additional  PRG  analyses  estimate  that  CETA  had  few  impacts  on  other 
outcomes  (e.g.,  receipt  of  welfare  or  unemployment  income,  criminal 
behavior,  graduation  from  high  school,  disciplinary  problems  in  school, 
or  health  status)  that  were  reliably  different  from  zero,  based  on  the 


8Because  the  published  description  of  these  procedures  is  garbled  in 
places,  it  is  not  entirely  clear  how  this  selection  strategy  would 
differ  from  a  cell-matching  procedure — except  for  the  arbitrary  manner 
in  which  the  size  of  the  "controlM  sample  is  set  (i.e.,  by  specifying  a 
sampling  fraction).  In  other  details,  there  are  also  several  puzzling 
aspects.  For  example,  great  efforts  are  put  into  constructing  a 
composite  family  income  and  social  status  indicator  (from  a  regression 
using  97  variables  reflecting  aspects  of  youths'  income  and  social 
status) ,  but  the  resultant  continuous  variable  (scaled  in  a  metric  of 
"expected"  family  income)  is  merely  dichotomized  (less  than  $15,000 
versus  more  than  $15,000  per  year). 

The  resulting  samples  were  then  used  to  estimate  program  impacts  by 
embedding  a  dichotomous  program  participation  variable  in  equations 
predicting  each  of  the  outcomes  shown  in  Table  D.4.  (Other  independent 
variables  in  these  equations  were  intended  to  control  for  region,  age, 
race,  pre-enrollment  employment  status,  family  income,  marital  status, 
educational  level,  and  health  status.)  It  will  be  seen  from  Table  D.4 
that  across  all  time  periods  studied,  PRG  estimates  that  the  net  impact 
of  CETA  was  -$28  per  month  on  earnings  from  unsubsidized  employment . 
Estimated  net  impacts  for  other  outcome  variables  are  also  negative  or 
"insignificant."  (Note,  however,  that  the  t-ratios  are  likely  to  be 
inaccurate  since  the  PRG  analysis  treated  the  NLS  data  as  if  they  had 
been  derived  from  a  simple  random  sample  of  the  population y  see  note 
5.)  The  sole  positive  result  shown  in  this  analysis  is  for  education, 
for  which  it  is  estimated  that  the  net  impact  of  CETA  was  to  increase 
the  probability  that  the  youth  would  remain  in  (or  return  to)  school  by 
5.6  percent. 
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TABLE  D . 4  PRG  Estimates  of  Net  Impact  of 
Participation  in  CETA  on  Employment,  Earnings, 
Education,  and  Marital  Behavior 


Outcome 

Impact  of 
CETA 

Months  of  unsubsidized 

-.051 

employment 

(2.85) 

Unsubsidized  earnings 

-27.698 

(2.34) 

Hours  of  unsubsidized 

-8.844 

employment  per  month3 

(3.89) 

Hours  of  unsubsidized  employment 

-.008 

with  wages  set  by  collective 
bargaining 

(.92) 

Probability  of  being  employed 

.028 

in  unsubsidized  job 

(1.59) 

Months  of  regular  school 

.014 

(.98) 

Probability  of  being  in 

.056 

regular  school 

(3.45) 

Probability  of  being  married 

-.088 

(.54) 

NOTE:  Averages  calculated  over  the  youth's 
postprogram  quarters,  up  to  12.  The  t  statistics 
appear  in  parentheses,  but  are  likely  to  be 
inaccurate;  see  note  5. 

aThis  entry  is  listed  in  source  as  "months  of 
unsubsidized  employment,"  not  hours ,  but  this  appears 
to  be  a  typographical  error,  since  it  duplicates  first 
entry  in  table. 

SOURCE:  Moeller  et  al.  (1983). 


PRG  computations.  The  two  exceptions  were  increased  use  of  drugs  among 
CETA  participants  (net  impact  +7.3  percent)  and  increased  likelihood  of 
being  married  (10.2  percent).9  However,  teenage  matrimony  would  be 
unlikely  to  qualify  as  a  positive  outcome  of  a  CETA  program,  and  of 


9Note  that  these  two  dependent  variables  are  also  dichotomies  which 
were  analyzed  using  OLS  procedures. 


course,  the  increased  "use  or  sale  of  marijuana,  hashish,  or  hard 
drugs"  would  be  thought  by  most  observers  to  be  a  negative  social 
outcome.  The  sole  optimistic  findings  of  the  PRG  analysis  occur  two 
years  after  program  completion.  For  selected  quarters,  the  authors 
find  evidence  of  positive  net  impacts  of  CETA  on  unsubsidized  earnings 
and  employment  status.  These  impacts  were  not,  however,  reliably 
different  from  zero  (using  the  authors'  statistics)  at  the  time  of  the 
last  NLS  measurements  (33-36  months  after  program  completion) . 


BIASES  IN  ESTIMATES  OF  PROGRAM  EFFECTIVENESS  ARISING  FROM 
USE  OF  MATCHED  SAMPLES  RATHER  THAN  RANDOM  ASSIGNMENT 

Across  the  three  CLMS  studies,  there  is  a  pattern  of  preponderantly 
negative  net  impacts  on  youths,  and  the  NLS  studies  show  extremely  weak 
effects  of  program  participation.  These  results  invite  the  conclusion 
that  federally  funded  employment  and  training  programs  have  had  (in  the 
aggregate)  either  little  effect  or  a  deleterious  effect  on  the  future 
earnings  and  employment  prospects  of  the  youth  who  participated  in  the 
programs.  There  is,  however,  reason  to  suspect  (and  empirical  evidence 
to  support  the  suspicion)  that  the  foregoing  estimates  may  be  biased 
downward. 

The  reason10  for  this  suspicion  is  that  (despite  intensive  and 
varying  efforts  to  select  comparison  groups  similar  to  participants  in 
youth  programs  and  to  control  for  selection  bias  through  use  of 
fixed-effects  estimators)  there  may  still  be  persistent  and  systematic, 
but  unobserved,  differences  in  the  earnings  profiles  of  comparison 
groups  and  true  controls.  Lower  earnings,  for  example,  might  be  due  to 
such  unobserved  factors  as  (perceived  or  actual)  differences  in  social 
attitudes,  motivation,  or  ability  between  program  participants  versus  a 
more  "mainstream"  comparison  group. 

A  study  by  Mathematica  (1984)  provides  important  evidence  on  the 
potential  for  bias  in  the  use  of  matching  strategies  such  as  those 
employed  in  the  NLS  and  CLMS  analyses  reviewed  above.  The  Mathematica 
study  used  data  from  a  true  experimental  design  that  randomly  assigned 


10 In  addition  to  the  potential  bias  in  the  matched  control  groups, 
there  are  two  other  reasons  to  question  negative  conclusions  from  the 
CLMS  studies.  The  CPS  lacks  data  on  enrollment  in  CETA  on  the  part  of 
the  comparison  group  and,  as  a  result,  positive  net  impacts  may  be 
underestimated  since  some  of  the  "controls"  were  actually  program 
participants.  In  addition,  postprogram  earnings  are  taken  from  SSA 
files,  which  contain  no  information  on  subsequent  education  or 
training.  However,  to  the  extent  that  CETA  encourages  further 
schooling,  it  reduces  immediate  postprogram  earnings  (and  therefore 
lowers  the  net-impact  estimate) ,  but  it  probably  should  be  viewed  as  a 
positive  impact  in  its  own  right.  Nevertheless,  this  interaction  has 
not  been  and  cannot  be  examined  with  the  available  data. 


youths  to  be  either  program  participants  or  controls,  it  then  compared 
net  impact  estimates  derived  using  the  experimental  design  with 
estimates  derived  using  the  same  sample  of  program  participants  but 
substituting  various  "matched  samples'8  constructed  from  the  CPS.11 
Mathematica  examined  net  impacts  based  on  simple  differences  in 
earnings  gains,  on  a  straightforward  earnings  regression  model ,  and  on 
a  fixed-effects  estimation  model.  Separate  comparisons  were  performed 
for  youths  and  women  receiving  Aid  to  Families  with  Dependent  Children 
(AFDC) . 

Based  on  a  true  control  group,  Mathematica  found  in-program  earnings 
gains  and  negligible  postprogram  effects  for  youths.  Comparison  of 
Supported  Work  participants  and  the  CPS  matched  sample,  however, 
yielded  either  insignificant  or  significantly  negative  effects. 
Moreover,  the  bias  apparent  in  the  match  sample  estimates  was  even 
greater  using  a  fixed-effects  estimator  rather  than  a  basic  earnings 
model. 

Figure  D.l  (from  Mathematica,  1984:Figure  III. 3)  illustrates  how 
this  bias  in  the  matched  samples  occurs.  The  age-earnings  profiles  of 
participants  and  true  controls  are  dramatically  different  in  the  years 
following  the  program  from  the  profiles  of  matched  controls  derived 
from  the  CPS  (regardless  of  which  of  the  three  matching  strategies  is 
used) . 

While  cell  matching  or  statistical  matching  reduces  mean  differ¬ 
ences  in  preprogram  earnings  and  in  background  characteristics, 
subsequent  earnings  still  diverge,  for  reasons  that  are  left  unobserved 
and  unexplained,  but  which  may  have  to  do  with  actual  or  perceived 
differences  in  motivation,  ability,  or  social  attitudes  (among  other 
possible  factors) .  (Alternatively,  it  may  be  the  case  that  the  scale 
of  subsidized  youth  programs  in  1978-1981  was  sufficiently  large  that 
the  programs  indirectly  improved  the  comparison  groups*  employment 
prospects.  By  temporarily  withdrawing  many  participants  from  the 
competitive  labor  market  for  low-income  youths,  the  programs  may  have 
enabled  some  nonparticipants  to  obtain  more  readily  whatever 
unsubsidized  jobs  were  available,  and  to  this  extent  they  boosted 
employment  outcomes  above  what  they  would  have  been  in  the  absence  of 
such  federally  funded  programs.) 

Results  for  AFDC  women  provide  an  interesting  contrast.  In  some 
instances,  the  Mathematica  analysis  finds  an  upward  bias  in  estimates 
of  program  effects.  But,  in  general,  both  the  true  control  group 
analyses  and  the  matched  control  group  analyses  show  large  and  signifi¬ 
cant  impacts  both  during  and  after  the  program.  No  clear  pattern  of 


11  Three  techniques  of  matching  were  used:  general  eligibility 
screens,  such  as  high  school  dropout;  cell  matching  and  weighting 
(similar  to  the  technique  used  by  Westat) ;  and  statistical  matching 
based  on  predicted  earnings  (rather  than  on  earnings-related  variables, 
as  done  by  SRI) . 
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FIGURE  D.l  Comparison  of  average  SSA  earnings  for  program  participan 
and  randomly  assigned  controls  in  Supported  Work  experiment  to  SSA 
earnings  for  "match  groups"  constructed  from  CPS  sample  using 
alternative  matching  strategies. 

SOURCE:  Mathematica  Policy  Research  (1984: Figure  III. 3)  . 


difference  is  found  between  the  results  obtained  using  a  basic  earnir 
model  and  a  fixed-effects  model.  Mathematica  argues  that  a  similar 
negative  bias  probably  exists  for  other  CETA  evaluations  using  con¬ 
structed  comparison  groups  rather  than  true  controls,  at  least  for 
youths,  and  it  specifically  cites  the  Westat,  SRI,  and  Urban  Institul 
findings  in  this  regard. 

Table  D.5  (from  Mathematica,  1984: Table  IV. 7)  shows  net  impact 
estimates  derived  from  Mathematica ' s  analyses  of  Supported  Work, 
together  with  estimates  of  overall  program  impact  from  the  studies  b] 
Westat,  SRI,  and  the  Urban  Institute.  Mathematica  acknowledges  that 
its  Supported  Work  sample  is  more  severely  disadvantaged  and  thereto] 
more  likely  to  have  lower  earnings  profiles  than  the  typical  CETA  yoi. 
participant.  Nevertheless,  there  is  some  overlap  of  the  two  groups, 
and  the  Supported  Work  program  did  primarily  provide  supervised  emplc 
ment,  which  is  an  element  of  youth  programs  common  to  on-the-job- 
training  projects,  work  experience  projects,  and  public  sector 
employment  projects. 


TABLE  D.5  Alternative  Estimates  of  Net  Impact  on  Earnings  (in  dollars 
per  year)  of  Participation  in  Supported  Work  and  CETA  Using  Alternative 
Comparison  Group  Methodologies  and  Estimation  Techniques 


Participant  Group 

Study  and  Methodology 

Youths 

AFDC  Women 

Supported  Work  participants 

Control  group  methodology 

Comparison  group  methodology3 

-  18 

-339  to  -1179** 

351* 

257  to  806** 

CETA  participants  with 
comparison  group  methodology 

Westatb 

SRI  using  Westat  comparison  group0 
SRI  using  SRI  comparison  group0 
Urban  Institute6 

-122d 
— 524***d 

-515**  to  -1303** 

500**  to  600** 

488*** 

246* 

556***  to  949***f 

NOTES:  Earnings  are  for  1978  for  Supported  Work  and  1979  for  CETA.  Supported  Work 
participants  tended  to  enroll  in  the  program  slightly  later  than  did  the  CETA 
participants  included  in  the  CETA  net-impact  studies.  For  this  reason,  1979 
outcome  measures  for  the  Supported  Work  samples  are  most  nearly  comparable  to  the 
1978  outcomes  for  the  CETA  participant  group  studied.  Published  significance 
levels  are  denoted  by  asterisks,  as  follows: 

*  p  less  than  .10 
**  p  less  than  .05 
***  p  less  than  .01 

However,  for  reasons  discussed  in  note  5,  these  levels  may  be  inaccurate. 

aExcludes  results  based  on  the  random  CPS  samples  meeting  the  Stage  1  screens. 
bSee  Westat,  Inc.  (1980:Tables  3-6). 

cSee  Dickinson  et  al.  (1984,  draft:Table  V.3) .  Results  reported  pertain  to 
enrollees  during  the  first  half  of  1976. 

°These  figures  pertain  to  male  youths  only.  Data  in  the  report  did  not  permit 
the  calculation  of  an  overall  impact  for  all  youths.  However,  only  12  percent  of 
the  Supported  Work  youth  were  female. 
eSee  Bassi  et  al.  (1984:Tables  3  and  22) . 

^These  figures  pertain  to  female  welfare  recipients.  Similarly  large  positive 
impacts  were  also  estimated  for  all  economically  disadvantaged  women. 


Because  of  such  similarities,  Mathematica  analysts  argue  that 
similar  biases  in  estimates  of  program  effectiveness  may  exist  in  the 
net  impacts  estimated  by  Westat,  SRI,  and  the  Urban  Institute,  and  they 
conclude  that  "It  is  not  possible  to  generate  reliable  net  program 
impact  estimates  using  ex-post  comparison  group  procedures." 
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CONCLUSION 

While  argument  may  be  had  (at  great  length  given  the  dearth  of 
reliable  evidence)  concerning  the  extent  to  which  the  Mathematica 
demonstration  of  bias  in  the  matched  sample  methodology  can  be 
generalized,  the  study  does  highlight  two  separate  problems  in 
net-impact  estimations  using  a  matched  comparison  groups 

1.  the  extent  to  which  employment  programs  recruit  or  attract 
participants  who  differ  from  eligible  nonparticipants  in  ways  that  me 
affect  subsequent  earnings;  and 

2.  the  extent  to  which  such  differences  can  be  detected  and 
controlled  using  available  demographic  or  preprogram  earnings  data. 
For  the  latter  problem  youths  presents  a  particularly  difficult  case 
for  any  match  strategy  because  preprogram  earnings  data  are  either  no 
extant  or  not  reliable  indicators  of  the  uncontrolled  variables  that 
are  of  interest  to  program  evaluators.12 

Estimates  of  the  magnitude  and  direction  of  the  bias  in 
matched-group  evaluations  are  only  available  for  the  one  youth  progra 
(Supported  Work)  whose  experimental  data  were  reanalyzed  by 
Mathematica.  From  this  reanalysis  we  have  an  elegant  demonstration 
that  commonly  used  "match"  strategies  would  have  yielded  an 
inappropriately  negative  evaluation  (where  the  experimental  data 
indicate  that  the  program  had  a  null  impact) .  There  is  an  obvious 
temptation  to  leap  from  this  one  result  to  the  assumption  that  biases 
equal  in  magnitude  and  direction  affect  all  other  "match  group" 
studies.  The  available  evidence,  however,  is  not  sufficient  to  warra 
such  a  sweeping  generalization.  Until  the  methodological  point  is 
clarified  by  expanding  on  the  provocative  paradigm  provided  by  the 
Mathematica  analysts,  there  is  considerable  uncertainty  as  to  the 
extent  to  which  this  finding  will  generalize  to  other  program 
evaluations  involving  different  populations  of  youths.  Providing  the 
requisite  data  will  take  a  renewed  commitment  to  conducting  the 
randomized  experiments  needed  to  make  estimates  of  the  magnitude  and 
direction  of  the  biases  involved  in  common  matching  strategies. 


12  In  contrast,  for  adult  women  receiving  Aid  to  Families  with 
Dependent  Children,  it  is  apparently  possible  to  control  for  such 
differences.  Welfare  payments  are  known,  and  preprogram  earnings  are 
much  better  indicator  for  adults  than  they  are  for  youths,  and  they  c 
be  used  both  in  selecting  a  matched  comparison  sample  and  as  a  contrc 
variable  in  the  net- impact  estimation.  Finally,  the  trend  in 
preprogram  earnings  can  be  used  to  test  for  "creaming"  or  other  samp] 
selection  biases  that  can  be  removed  from  the  estimates. 
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Knowledge  Development  Under  the  Youth  Employment 
and  Demonstration  Projects  Act,  1977-1981 

Richard  F.  Elmore 


INTRODUCTION 

In  July  and  August  of  1977,  Congress  passed  and  President  Carter 
signed  the  Youth  Employment  and  Demonstration  Projects  Act  (YEDPA) . 

The  law  substantially  increased  authorizations  for  two  existing  youth 
employment  programs,  the  Job  Corps  and  the  Summer  Youth  Employment 
Program  (SYEP) .  It  added  three  new  programs,  Youth  Community  Conser¬ 
vation  and  Improvement  Projects  (YCCIP) ,  the  Youth  Employment  and 
Training  Programs  (YETP) ,  and  the  Young  Adult  Conservation  Corps 
{ YACC) .  It  also  authorized  a  large-scale  demonstration  of  strategies 
designed  to  encourage  high-risk  youths  to  stay  in  school,  using 
guaranteed  work  as  an  incentive — the  Youth  Incentive  Entitlement  Pilot 
Projects  (YIEPP) .  {Table  1  summarizes  the  target  groups  and  activities 
included  within  these  programs,) 

In  the  fiscal  year  immediately  prior  to  the  passage  of  YEDPA, 
federal  outlays  for  youth  employment  programs  were  about  $955  million 
(Hahn,  1979).  Over  the  next  four  fiscal  years,  1978-1981,  about  $8 
billion  was  spent  on  programs  and  about  $500  million  on  research  and 
development  addressed  to  youth  employment,  serving  about  1.5  million 
youths  annually  (see  Tables  2  and  3) .  YEDPA  was  administered  by  a 
newly  created  Office  of  Youth  Programs  (OYP) ,  which  was  located  in  the 
Employment  and  Training  Administration  (ETA)  of  the  U.S.  Department  of 
Labor  (DOL)  and  which  relied  on  a  large  number  of  independent  contrac¬ 
tors,  as  well  as  state,  local,  and  other  federal  agencies. 

Included  in  the  legislation  authorizing  YEDPA  was  a  broad  charge 
"to  explore  methods  of  dealing  with  the  structural  unemployment 
problems  of  the  Nation's  youth"  and  "to  test  the  relative  efficacy  of 
different  ways  of  dealing  with  these  problems  in  different  local 
contexts."  This  charge  was  backed  by  substantial  discretionary 
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TABLE  1  Federal  Youth  Employment  Programs,  1977-1981 


Program 


Job  Corps 


Summer  Youth 
Employment 
Program  (SYEP) 
Youth  Community 
Conservation 
and  Improvement 
Projects 
( YCCIP) 

Youth  Incentive 
Entitlement 
Pilot  Projects 
(YIEPP) 


Young  Adult 
Conservation 
Corps  ( YACC) 


Youth  Employment 
and  Training 
Programs  ( YETP ) 


Target  Group 


Activity 


16-21;  economically 
disadvantaged 


14-21;  economically 
disadvantaged 

16-21;  unemployed; 
preference  to 
economically  disad¬ 
vantaged 

16-19;  economically 
disadvantaged;  17 
selected  sites — 

7  large  cities  , 

10  smaller  cities 


16-23;  unemployed 


14-21;  at  least 

85  percent  economically 
disadvantaged 


Residential  centers; 
education,  skill  train 
ing ,  work  experience, 
counseling,  health  car 
stipends;  centers  admi 
istered  in  cooperation 
with  other  federal 
agencies,  state  and 
local  governments,  and 
non-profit  organizatio 
Work  in  public  or  privat 
nonprofit  agencies;  sc 
educational  enrichment 
Work  in  community-planne 
public  projects 


Two-year  demonstration; 
guarantee  of  minimum 
wage,  part-time  work 
during  school  year,  fu 
time  work  during  summe 
contingent  on  satisfac 
tory  performance  in 
school  and  work 

Work  for  up  to  1  year  on 
conservation,  public 
projects;  by  statute, 
70  percent  administers 
through  interagency 
agreements  with 
Departments  of  Interio 
and  Agriculture,  30 
percent  through  formul 
to  states 

Classroom  or  on-the-job 
training,  work  experi¬ 
ence,  pre-employment 
skills;  administered 
through  local  prime 
sponsors;  22  percent 
set-aside  for 
cooperative  programs 
with  local  educational 
agencies 


TABLE  2  Outlays  for  Federal  Youth  Employment  Programs, 
Fiscal  1978-1981  (in  millions  of  dollars) 


Fiscal 

Program 

1978 

1979 

1980 

1981 

Job  Corps 

280 

380 

470 

465 

SYEP 

670 

660 

721 

769 

YCCIP 

61 

103 

122 

0 

YIEPP 

March 

1978-August  1980:  218 

YACC 

139 

273 

234 

174 

YETP 

294 

556 

695 

719 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1980a,  1981,  1982) . 

authority  and  money,  granted  to  the  secretary  of  labor  and  delegated  to 
the  Office  of  Youth  Programs,  to  conduct  research,  demonstration,  and 
evaluation  activities  around  the  structural  unemployment  problems  of 
youths.  This  effort  was  described  with  the  arresting  phrase  "knowledge 
development. " 

The  youth  employment  knowledge  development  effort  was  remarkable  in 
many  respects:  It  was  one  of  the  largest  short-term  investments  in 
social  research  and  development  ever  undertaken  by  the  federal  govern¬ 
ment.  Its  scale  and  complexity  dwarfed  any  research  and  development 
effort  undertaken  by  the  Department  of  Labor  before  or  since.  It 
generated  a  large  body  of  research,  evaluation,  and  practical  knowledge, 
which  is  only  now  being  sorted,  assessed,  and  assimilated  into  policy 
and  practice.  It  coincided  with  a  sharp  surge  in  political  attention 
to  youth  employment  problems,  creating  many  opportunities  for  connect¬ 
ing  research  with  policy.  And  it  galvanized  a  broad-based  national 
constituency  of  policy  makers,  researchers,  and  local  practitioners,  at 
least  for  a  short  time,  around  the  problems  of  youth  employment.  These 
features  argue  for  a  retrospective  look  at  the  process. 

This  paper  analyzes  the  conduct  of  the  knowledge  development 
effort,  from  its  origins  in  congressional  decision  making,  to  its 
design,  implementation,  and  results.  The  paper  addresses  five  main 
questions: 

(1)  What  congressional  and  executive  expectations  shaped  the 
knowledge  development  process? 

(2)  How  was  the  knowledge  development  process  designed? 

(3)  How  was  the  process  organized  and  managed? 

(4)  How  has  the  process  influenced  policy  and  practice  in  youth 
employment? 

(5)  What  lessons  can  be  learned  from  the  process  that  might  shape 
future  large-scale  research  and  development  efforts  in  social  policy? 

Because  the  knowledge  development  effort  was  vast  and  the  scope  of  this 
analysis  is  modest,  the  answers  to  these  questions  are  necessarily 


TABLE  3  Participation  in  Federal  Youth  Employment 
Programs,  Fiscal  1978-1981  (headcounts) 


Program 

1978 

1979 

1980 

1981 

Job  Corps 

72,000 

85,000 

103,800 

114,4i 

SYEP 

1,009,300 

888  ,000 

800,000 

774, 0( 

YCCIP 

28,700 

38,500 

43,000 

38,4 

YIEPP 

March  1978- 

-August  1980: 

72,000 

YACC 

51,900 

67,200 

68,000 

68,0- 

YETP 

359,200 

413,600 

463,000 

393, 7( 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1980a,  1981,  1982) . 


tentative  and  incomplete.  But,  even  with  these  limitations,  the  pap< 
provides  an  occasion  to  examine  the  broader  consequences  of  large-sc 
investments  in  social  research  and  development.  It  also  provides  a 
political  and  organizational  complement  to  more  methodologically 
oriented  reviews  of  the  evidence. 

The  YEDPA  knowledge  development  effort  raises  questions  that  hav 
run  through  federal  investments  in  social  research  and  development 
since  at  least  the  mid-1960s.  Prior  to  that  time — during  the  New  De 
for  example — the  unspoken  assumption  was  that  public  money  spent  on 
remediation  of  social  problems  was  effective  simply  by  having  been 
spent.  In  the  1930s,  the  National  Youth  Administration’s  employment 
programs  and  the  Civilian  Conservation  Corps  were  assumed  to  have 
accomplished  their  purposes  when  federal  money  was  transferred  throu< 
public  employment  to  unemployed  young  people. 

In  the  1960s,  this  view  began  to  shift  markedly.  It  was  no  long* 
adequate  justification  for  public  expenditures  simply  to  pass  money 
from  the  government  to  individuals  who  needed  it;  public  expenditure 
had,  in  some  way,  to  contribute  to  the  long-term  solution  of  basic 
structural  problems  in  society — poverty,  unemployment,  crime, 
delinquency,  and  the  like.  Some  argued  that  even  this  was  not 
sufficient  justification,  proposing  instead  that  expenditures  be  bas 
on  comparisons  of  their  net  returns  to  society,  rather  than  just  on 
their  relationship  to  social  problems. 

This  shift  in  perspective  coincided  with  a  marked  increase  in 
federal  social  expenditures  and  at  least  a  five-fold  increase  in 
federal  expenditures  on  social  research  and  development  (Rein  and 
White,  1977).  The  dominant  theme  of  social  research  and  development 
the  1960s  and  1970s  was  the  seemingly  straightforward  matter  of 
"finding  out  what  works"  (Rivlin,  1971) .  The  dominant  analytic  mode 
was  a  combination  of  experimental  method  and  economic  analysis. 
Experimental  method,  which  in  its  most  rigorous  form  prescribes  pre- 
and  post-measurement  coupled  with  random  assignment  of  subjects  to 
treatment  and  control  groups,  would  provide  the  means  of  disentangli 


the  effects  of  social  programs  from  the  effects  of  various  other 
factors.  Economic  analysis  would  provide  the  means  of  attributing 
value  to  program  effects  and  of  assessing  their  net  social  benefit. 

As  the  custodian  of  expertise  and  money  in  this  effort,  "the 
federal  government  should  take  the  leadership  in  organizing,  funding, 
and  evaluating  systematic  experiments  with  various  ways  of  delivering 
education,  health,  and  other  social  services  .  .  .  trying  out  new 
methods  in  various  places  under  various  conditions"  (Rivlin, 
1971:86-87).  The  evidence  emerging  from  these  systematic  experiments 
would  inform  public  policy  decisions.  The  underlying  assumptions  were 
that  (1)  knowledge  of  effects  and  net  benefits  was  a  key  determinant  of 
public  policy  decisions;  (2)  systematic  knowledge,  when  marshaled  in 
support  of  decisions,  would  be  used  by  policy  makers?  and  (3)  better 
knowledge  meant  better  decisions  and  more  value  to  society  from  social 
expenditures. 

This  analytic  model  produced  some  notable  successes — well-conceived 
and  well- implemented  experiments  in  income  maintenance,  health  insur¬ 
ance,  and  housing  subsidies — and  some  notable  embarrassments — vaguely 
conceived  and  erratically  implemented  experiments  in  educational 
vouchers,  compensatory  education,  and  educational  performance  contract¬ 
ing,  for  example.  The  analytic  model  also  began  to  find  its  way  into 
federal  evaluation  requirements  that  accompanied  categorical  grants  and 
federally  sponsored  research  and  demonstration  activities  under  the 
umbrella  of  operating  programs.  In  education,  for  example,  a  national 
Dissemination  Review  Panel  was  established  to  review  evaluations  of 
exemplary  programs  for  methodological  rigor  and  results  and  to 
"validate"  those  programs  for  broad-scale  dissemination.  Parallel 
patterns  developed  in  delinquency  prevention,  employment,  and  mental 
health. 

This  analytic  model  had  no  sooner  become  a  fixture  of  federal 
policy  than  experience  began  to  surface  a  number  of  problems: 

8  Timing.  Social  experiments  and  evaluations,  especially  the 
well-conceived  ones,  took  so  long  to  produce  results  that  they  usually 
answered  questions  no  longer  being  asked  by  policy  makers.  The  demands 
of  the  political  process  were  out  of  synch  with  what  the  experimental 
method  could  produce. 

8  The  Nature  of  the  Treatment.  Most  of  the  notable  successes 
with  social  experimentation  were  with  policies  involving  relatively 
simple  cash-transfers  (income  maintenance,  health  insurance,  and 
housing  subsidies) .  Most  of  the  notable  failures  were  with  policies 
involving  complex  changes  in  existing  organizations,  the  creation  of 
new  organizations,  or  the  delivery  of  highly  individualized  services. 

8  Organizational  Complexity.  The  large-scale  accumulation  of 
knowledge  about  social  problems  turned  out  to  require  orchestrating 
competing  political  demands,  marshaling  money  and  expertise  behind 
policy  questions,  and  constructing  organizations  to  deliver  services 
and  do  research.  The  skills  necessary  for  these  activities  were  more 
akin  to  the  skills  of  management  than  the  skills  of  scientific  inquiry. 
People  who  have  the  required  management  skills  do  not  necessarily  have 
the  skills,  interest,  or  commitment  to  scientific  inquiry,  and  vice 
versa. 


•  Implementation .  Complex  interventions  have  to  be  implemented 
before  they  can  be  tested.  Implementation  requires  skill  and  commiti 
from  people  whose  main  interest  is  in  delivering  services,  not  in 
"finding  out  what  works."  Implementation  also  requires  organizations 
and  administrative  capacity — people  and  institutions  who  are  ready  tc 
apply  their  practical  knowledge  to  the  problems  raised  by  policymakei 
These  practical  concerns  often  came  as  a  shock  to  social  scientists 
whose  main  concerns  were  methodological  and  theoretical. 

•  Variability  and  Robustness.  The  cash-transfer  experiments 
seemed  to  produce  findings  that  were  robust  from  one  setting  to  anotl: 
if  not  from  one  experiment  to  the  next.  Evaluations  and  experiments 
requiring  complex  organizational  solutions  and  individualized  service 
produced  findings  that  were  highly  sensitive  to  setting — differences 
among  sites  were  consistently  greater  than  differences  among  treatmer 
across  sites. 

•  Small,  Ambiguous  Effects.  The  social  interventions  of  the 
mid-1960s  were  justified  politically  in  rhetoric  that  suggested 
broad-scale  reform  of  society.  The  actual  results  of  experiments  anc 
program  evaluations  showed  small,  often  inconclusive  effects.  The 
interventions  worked  with  some  groups  and  not  others;  the  effects  wer 
sometimes  so  small  as  to  be  of  questionable  practical  significance; 
important  sources  of  variation  (site-to-site  differences,  for  example 
were  often  not  included  in  the  design  of  evaluations;  and  effects  ofi 
did  not  persist  over  time. 

•  Methodological  Uncertainty.  Better-designed,  more  rigorous, 
more  analytically  sophisticated  experiments  and  evaluations  did  not 
reduce  the  uncertainty  and  conflict  surrounding  policy  decisions, 
indeed,  they  often  aggravated  it.  Serious  discussions  of  important 
policy  questions  often  got  sidetracked  into  arcane  debates  over 
methodological  decisions,  analytic  assumptions,  and  statistical 
techniques,  leaving  the  intended  consumers  of  the  results  confused. 
The  most  frequent  conclusions  of  policy  research  were  recommendations 
for  more  research.  The  research  community  seemed  reluctant  to  apply 
the  same  benefit-cost  calculus  to  its  own  work  that  it  applied  to 
social  policy. 

•  Conflict  Between  Science  and  Practice.  As  the  application  of 
social  science  to  social  policy  making  proceeded,  the  breach  widened 
between  people  who  delivered  services,  on  the  one  hand,  and  the  peop] 
who  conducted  experiments  and  evaluations,  on  the  other,  practitione 
argued  that  the  quantitative  findings  of  rigorous  research  and  evalus 
tion  were  too  abstract  to  be  of  any  practical  use,  too  insensitive  t< 
practical  problems,  and  that  experimentation  and  evaluation  were 
expensive  ornaments  hung  on  social  programs  for  the  benefit  of  sociaJ 
scientists.  Social  scientists  argued  that,  without  a  scientific  basj 
practice  could  not  be  justified  to  the  public  and  that  resistance  to 
systematic  analysis  stemmed  from  the  professional's  usual  hostility  1 
external  scrutiny. 

It  was  impossible  to  engage  in  large-scale  policy  research,  experimei 
tion,  or  evaluation  in  the  1970s — or  the  1980s,  for  that  matter — witl 


confronting  these  problems  in  one  form  or  another.  They  were  part  of 
the  baggage  of  systematic  inquiry  in  the  service  of  policymaking. 

Out  of  these  misgivings  there  began  to  emerge  a  different,  more 
tempered  view  of  the  connection  among  systematic  inquiry,  policy,  and 
practice.  The  utility  of  experimental  method  and  economic  analysis 
came  to  be  defined  in  narrower  terms.  Rigorous  social  experimentation 
required  relatively  strong  theory,  analytic  skill,  time,  money,  and 
organizational  capacity — conditions  that  could  not  be  met  in  all 
instances.  Social  scientists  began  to  acknowledge  an  explicit  tradeoff 
between  internal  validity  (the  ability  to  distinguish  treatment  effects) 
and  external  validity  (the  ability  to  generalize  effects  beyond  an 
experiment) .  The  degree  of  experimental  control  required  for  a  precise 
estimate  of  effects  was  to  some  degree  inconsistent  with  the  ability  to 
transfer  the  treatment  from  an  experimental  setting  to  a  practical 
operating  environment.  Policy  analysts  began  to  speak  with  more  respect 
about  the  "ordinary  knowledge"  (Lindblom  and  Cohen,  1979)  ,  or  practical 
understanding,  necessary  to  make  complex  decisions  and  to  get  from  an 
analytic  result  to  a  prescription  for  action,  views  about  the  relation¬ 
ship  among  systematic  inquiry,  policy,  and  operating  decisions  became 
more  elaborate  and  less  hard  edged. 

Systematic  inquiry,  even  when  it  met  rigorous  methodological  stan¬ 
dards,  was  rarely  brought  to  bear  on  clearly  specified  decisions — 
legislative,  budgetary,  or  administrative.  But  systematic  inquiry  did 
have  longer-term,  more  diffuse  effects  on  the  conventional  wisdom  that 
policy  makers  used  to  define  problems,  on  the  way  organizations  were 
structured,  on  the  directions  administrators  pushed  their  organizations, 
and  on  the  way  practitioners  handled  day-to-day  problems  in  providing 
services.  The  shifts,  in  other  words,  were  less  a  repudiation  of  the 
experimental/analytic  model  and  more  a  domestication  of  it  to  political, 
organizational,  and  operating  realities. 

The  Department  of  Labor  had,  by  the  mid-1970s,  accumulated  con¬ 
siderable  capacity  and  experience  in  economic  analysis  and  evaluation, 
although  its  experience  with  large-scale  experimentation  was  more 
limited.  The  department's  analytic  functions  in  the  employment  and 
training  area  were  the  responsibility  of  the  Office  of  the  Assistant 
Secretary  for  Policy  Evaluation  and  Research  (ASPER)  and,  within  the 
Employment  and  Training  Administration,  the  Office  of  Policy  Evaluation 
and  Research  (OPER) .  The  Policy  Evaluation  and  Research  budget  of  DOL 
was  consistently  around  $35  million  a  year  between  1976  and  1980;  over 
$20  million  was  in  earmarked  appropriations  and  about  $15  million  in 
discretionary  funds  (apart  from  YEDPA) .  The  varied  collection  of  state 
and  local  government  agencies  and  community -based  organizations  that 
delivered  employment  and  training  services  under  the  Comprehensive 
Employment  and  Training  Act  (CETA)  had  become  acclimated  to  a  relatively 
high  level  of  federally  required  evaluation,  but  no  less  resistant  to 
its  costs  and  inconveniences.  An  array  of  external  research  and 
evaluation  organizations  had  developed  around  DOL-sponsored  evaluations, 
as  well  as  a  large  array  of  university-based  research  organizations. 

Not  much  of  this  capacity  for  research  and  analysis,  however,  was 
focused  specifically  on  youth  employment — a  matter  that  would  become 
important  with  the  passage  of  YEDPA. 
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The  youth  employment  knowledge  development  effort  commenced 
time,  then,  when  federal  investment  in  analysis,  research,  and 
tion  related  to  employment  had  been  relatively  high  for  a  numbe 
years,  when  methodological  and  analytic  sophistication  were  on 
rise,  when  major  uncertainties  were  surfacing  about  the  role  of 
systematic  inquiry  in  the  service  of  policy  making,  and  when  th 
administrative  structure  for  employment  programs  had  become  acc 
to,  if  not  totally  accepting  of,  evaluation.  The  uncertainties 
characterized  policy  analysis,  research,  and  evaluation  general 
that  time  were  necessarily  part  of  any  effort  to  apply  systemat 
inquiry  to  the  youth  employment  problem. 

Among  the  questions  growing  out  of  this  larger  context  are 
following : 

•  What  constitutes  "useful"  knowledge?  Is  the  utility  of 
knowledge,  and  hence  the  value  gained  from  investment  in  system 
inquiry,  to  be  judged  in  strictly  methodological  and  quantitati 
terms — that  is,  are  "useful"  results  measures  of  specific  impac 
which  no  alternative  causal  explanation  can  be  offered  under  th 
methodological  conventions  of  social  science?  Or  is  the  utilit 
results  more  a  matter  of  practical  use — that  is,  "useful"  resul 
those  that  are  perceived  to  be  helpful  in  solving  political, 
administrative,  and  practical  problems? 

•  What  should  be  the  relationship  between  the  delivery  of 
services  and  the  discovery  of  effects?  Is  it  the  primary  respo 
bility  of  government  agencies  to  deliver  services  to  people,  co 
with  the  political  decisions  of  elected  officials?  Or  is  their 
responsibility  to  "find  out  what  works,"  consistent  with  the  ec 
criterion  of  positive  net  benefit?  is  it  possible  to  accommoda 
delivery  of  services  and  the  measurement  of  effects  within  a  si 
organizational  structure?  Should  the  delivery  of  services  be  c 
strained  by  the  methodological  conditions  necessary  to  identify 
or  should  methodological  conditions  be  constrained  by  the  pract 
necessities  of  delivering  services? 

•  What  are  the  political  and  organizational  correlates  of 
successful  accumulation  of  knowledge?  If  the  accumulation  of  k 
about  social  problems  requires  orchestrating  competing  politica 
demands,  marshaling  money  and  expertise  behind  policy  questions 
constructing  organizations  to  deliver  services  and  do  research, 
how  do  we  distinguish  between  better  and  worse  ways  of  doing  th 
things? 

•  What  payoffs  should  we  expect  from  large-scale  research, 
demonstration,  and  evaluation  activities?  Should  the  payoffs  b 
order  of  "solutions  to  the  problem  of  youth  unemployment"?  Or 
sufficient  to  offer  solutions,  on  the  order  of  "ways  to  reduce 
school  dropout  rate"  or  "ways  to  impart  employment  skills,"  tha 
constructive  solutions  to  practical  problems,  but  little  hope  o 
solving  the  overall  problem? 

The  analysis  that  follows  is  divided  into  five  main  section 
expectations  about  knowledge  development  on  the  part  of  Congres 


the  executive  branch;  (2)  design  of  the  knowledge  development  effort; 
(3)  organization  and  management  of  the  effort;  (4)  influence  of  the 
effort  on  policy  and  program;  and  (5)  guidance  for  the  future  that 
might  be  gained  from  the  knowledge  development  effort. 


POLITICAL  EXPECTATIONS 

Shortly  after  the  inauguration  of  President  Carter  in  January  1977, 
several  representatives  of  the  new  administration  were  summoned  to  a 
meeting  on  the  Senate  side  of  the  Capitol  Building.  The  Carter 
appointees  were  Bill  Spring,  from  the  White  House  Domestic  Policy 
Staff;  Ray  Marshall,  secretary  of  labor;  Ernest  Green,  assistant 
secretary  for  employment  and  training;  and  Nik  Edes,  deputy  under¬ 
secretary  for  legislative  and  intergovernmental  affairs  at  the  Labor 
Department.  From  the  Senate  was  assembled  a  rare  array  of  senior 
members.  Among  the  Democrats  were  Henry  Jackson,  Washington;  Hubert 
Humphrey,  Minnesota;  Edward  Kennedy,  Massachusetts;  Alan  Cranston, 
California;  Harrison  Williams,  New  Jersey;  Gaylord  Nelson,  Wisconsin; 
and  Jennings  Randolph,  West  Virginia.  Among  the  Republicans  were  Jacob 
Javits,  New  York,  and  Robert  Stafford,  Vermont. 

According  to  Nik  Edes  and  Richard  Johnson,  then  staff  director  of 
Nelson's  Senate  Employment  Subcommittee,  the  Senators  delivered  a 
simple  message  to  the  Carter  appointees;  A  youth  employment  bill  would 
be  introduced  in  the  Senate  immediately,  with  or  without  administration 
support.  The  administration  could  collaborate  or  be  left  behind. 

The  reasons  for  the  pressure  were  political.  According  to  Johnson, 
"There  were  youth  proposals  coming  from  all  over  the  Senate;  they  could 
have  gone  to  [the]  public  works,  interior,  or  labor  [committees] . 

Javits  sensed  that  the  whole  thing  was  about  to  come  apart.  Whichever 
committee  got  to  the  floor  first  with  a  proposal  would  get  credit.  He 
decided  it  was  time  to  call  a  meeting.  He  told  the  administration, 
'We're  about  to  produce  a  piece  of  legislation.  If  you  want  in,  now  is 
the  time ' . " 

Spring,  recently  transplanted  from  the  Senate  Labor  and  Public 
Welfare  Committee  Staff  to  the  White  House,  recalls,  "It  was  a  rescue 
effort  by  the  Labor  and  Public  Welfare  Committee  to  maintain  its 
jurisidiction .  Javits  [ranking  member  of  the  Labor  and  Public  Welfare 
Committee]  saw  that  Jackson  [chair  of  the  Interior  Committee]  and 
Randolph  [chair  of  the  Public  Works  Committee]  were  about  to  move,  and 
understood  that  if  something  didn't  happen  quickly  they  were  going  to 
lose  it." 

Within  weeks,  Edes,  Johnson,  and  Spring  had  drafted  a  proposal 
incorporating  the  special  programs  of  the  key  Senators.  This  particula 
selection  of  staff  was  not  accidental.  Edes  and  Spring,  representing 
the  Carter  administration,  had  only  weeks  before  been  members  of  the 
Senate  staff — Edes  working  for  Senator  Williams,  chair  of  Labor  and 
Public  Welfare,  and  Spring  working  for  Senator  Nelson,  chair  of  the 
Employment  Subcommittee.  According  to  Spring,  "It  was  the  old  Senate 
staff  pulling  together  around  an  issue.  There  really  wasn't  an 
administration  position,  because  the  Carter  White  House  hadn't  gotten 
organized . " 


Congressional  Perspective 


According  to  Johnson,  "As  far  as  the  Senators  were  concerned,  the 
ideas  were  simple.  You  needed  to  have  better  cooperation  between  the 
schools  and  the  employment  and  training  system.  You  needed  to  do 
something  about  dropouts.  You  needed  to  provide  opportunities  for  kic 
in  trouble  with  the  schools  to  do  useful,  productive  work  and  prepare 
themselves  for  employment."  Jackson,  Humphrey,  and  Randolph  came  of 
age  politically  in  the  New  Deal.  Their  ideas  about  what  young  people 
needed  were  consistent  with  the  New  Deal  view  of  employment  in  the 
service  of  conservation  and  public  works.  YACC  and  YCCIP  were  manifes 
tations  of  this  view.  Nelson  and  Williams  had  a  large  political  stake 
in  maintaining  their  committee's  jurisdiction  over  employment  policy 
and  assuring  that  the  federal  employment  and  training  structure  provic 
adequate  access  for  youths.  YETP  was  the  solution  to  that  problem. 
Javits's  special  interest  was  in  the  connection  between  the  schools  ar 
the  employment  and  training  system.  On  the  strength  of  Javits's 
interest,  a  provision  was  drafted  requiring  that  a  proportion  of  YETP 
funds  (originally  15  percent,  later  22  percent)  be  allocated  to  projec 
jointly  involving  local  education  agencies  (LEAs)  and  CETA  prime 
sponsors. 

For  the  Carter  administration  the  top  domestic  priority  was  dealii 
with  persistent  inflation  and  rising  unemployment.  Youth  employment, 
per  se,  was  not  part  of  their  early  agenda.  As  one  congressional  staj 
member  said,  "They  didn't  have  any  hip-pocket  proposals  on  youth 
employment  coming  out  of  the  transition,  so  it  was  relatively  easy  foi 
them  to  buy  into  whatever  the  Senate  had  to  offer."  On  January  31, 
1977,  Carter  proposed  a  $20  billion  emergency  economic  stimulus  packac 
composed  of  supplemental  budget  requests  for  fiscal  1977,  to  cover  th< 
18-month  period  from  April  1977  to  September  1978.  The  package  con¬ 
tained  an  $8  million  addition  to  public  service  employment  (PSE) ,  $4 
billion  for  public  works  jobs,  over  $5.5  billion  in  aid  for  local 
governments,  and  $1.5  billion  for  unspecified  youth  employment  prograr 

The  administration's  original  intent  was  to  implement  its  youth 
program  administratively,  without  new  legislative  authority.  Senate 
aide  Richard  Johnson  said,  "We  told  them,  'You  can't  do  that  on  Capit< 
Hill,  legislators  want  to  pass  legislation  and  get  some  visibility'." 
So  on  March  9,  the  administration  followed  with  a  youth  employment 
message,  containing  a  proposal  that  had  been  worked  out  jointly  with 
the  Senate.  It  requested  authority  for  three  new  youth  programs — YAC< 
YCCIP,  YETP;  it  provided  a  set-aside  of  joint  school-prime  sponsor 
projects;  and  it  provided  that  half  the  YETP  funds  would  be  distributi 
by  formula  to  prime  sponsors  and  the  other  half  used  to  fund  "innovat: 
and  experimental"  programs  at  the  discretion  of  the  secretary  of  labo] 
or  his  designee. 

Explaining  the  purpose  of  the  discretionary  funding,  Richard  John: 
argued,  "We  [the  Senate]  had  always  been  inclined  to  put  rather  gener< 
discretionary  funding  into  the  employment  programs  because  we  recogni: 
that  the  formulas  for  distributing  money  sometimes  resulted  in  probler 
getting  the  money  to  the  right  constituencies."  For  the  Senate,  in 
other  words,  discretionary  funding  was  a  way  of  adjusting  formula-func 
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programs  to  special  geographical,  political,  or  organizational 
interests . 

In  retrospect,  according  to  DOL's  Nik  Edes,  "leaving  the  House  out 
of  the  early  negotiations  was  a  major  tactical  error."  The  administra¬ 
tion's  affinity  for  working  with  the  Senate  was  understandable.  Two 
key  actors  for  the  administration,  Edes  and  Spring,  were  former  Senate 
staff.  Also,  according  to  Spring,  "The  House  got  left  out  because  the 
internal  politics  of  the  Senate  were  so  delicate  we  were  afraid  we'd 
lose  the  whole  thing  if  we  tried  to  accommodate  the  interests  of  House 
members  too." 

When  the  House  got  wind  of  a  Senate-administration  proposal,  they 
decided  to  move  on  their  own  youth  employment  bill.  The  late  Carl 
Perkins,  chair  of  the  House  Education  and  Labor  Committee,  and  Augustus 
Hawkins,  newly  designated  chair  of  the  Employment  Subcommittee,  intro¬ 
duced  the  administration's  youth  employment  bill  on  April  6  and  then 
developed  an  alternative  proposal.  According  to  a  member  of  the  House 
staff,  "The  White  House  didn't  have  a  lot  of  experience  in  these  things; 
they  said,  'Wait  a  minute,  you  can't  develop  your  own  bill;  we  already 
have  a  bill  in.'  We  went  ahead  with  our  own  proposal." 

The  Senate  and  House  approaches  differed  in  several  respects. 

First,  whereas  the  Senate  proposal  created  new  programs  focused  on 
youths,  the  House  proposal  amended  Title  III  of  CETA,  a  general  grant 
of  discretionary  authority  to  the  secretary  of  labor  for  research  and 
demonstration  projects.  The  Senate  saw  itself  as  initiating  new,  more 
or  less  permanent,  youth  employment  programs.  The  House,  by  contrast, 
saw  itself  as  initiating  demonstration  projects  that  would  form  the 
basis  for  later,  more  permanent  programs.  In  a  House  staff  member's 
words,  "our  philosophy  was  'let  a  thousand  flowers  bloom,'  and  then 
come  back  after  we'd  had  some  experience  and  decide  what  was  promising." 

Another  key  Senate-House  difference  was  the  House's  Youth  Incentive 
Entitlement  Pilot  Projects  (YIEPP) .  YIEPP  was  important  politically  to 
the  House  proposal  because  it  originated  from  the  Republican  side. 
According  to  Nat  Semple,  minority  staff  to  the  House  Employment 
Subcommittee,  the  idea  had  its  origins  long  before  1977.  "Marvin  Esch 
[former  Republican  member  from  Michigan]  liked  to  think  in  big  terms. 

He  had  kids  of  his  own  and  he  was  concerned  about  how  to  get  kids  to 
stay  in  school  and  how  to  get  schools  to  respond  to  kids  who  might  not 
be  the  greatest  academically.  We  had  a  long  discussion  one  evening 
after  work  over  hamburgers  and  beer  at  the  Hawk  and  Dove  [a  Capitol 
Hill  eatery]  and  I  started  sketching  out  the  ideas  for  entitlement  on 
the  tablecloth.  The  problem  was  how  to  get  the  Republicans  to  buy  off 
on  some  kind  of  a  job  guarantee.  We  struck  on  the  idea  of  a  contract. 
The  kids  would  have  to  agree  to  stay  in  school  in  return  for  a  job. 

There  would  be  rules  and  structure.  We  weren't  offering  something  for 
nothing.  The  whole  idea  was  basically  very  conservative:  keep  kids  in 
school,  promote  the  work  ethic,  make  kids  contract  for  benefits,  etc. 

It  had  a  lot  of  appeal  to  the  Republicans."  Esch  ran  for  the  Senate 
from  Michigan  in  1976  and  lost.  Semple  took  the  entitlement  proposal 
to  Ronald  Sarasin,  moderate  Republican  from  Connecticut,  and  Sarasin 
agreed  to  sponsor  it. 


A  common  element  of  all  proposals  was  an  initial  1-year 
authorization.  The  entire  CETA  package  was  due  to  expire  in  1978. 
Everyone  anticipated  that  youth  employment  would  be  integrated  into 
CETA  when  the  1978  reauthorization  occurred.  Rather  than  putting  yout 
programs  on  a  different  authorization  schedule  than  the  rest  of  CETA, 
there  was  substantial  agreement  that  the  new  youth  programs  should  be 
authorized  for  1  year  and  then  taken  up  again  in  1978  with  the 
reauthorization  of  CETA.  In  explaining  why  the  proposal  was  couched  i 
the  language  of  demonstration  projects,  rather  than  new  programs,  the 
House  Committee  Report  said,  "The  Committee  approach  allows  for 
learning  as  much  as  we  can  in  order  that  when  CETA  is  reauthorized  nex 
year,  the  Committee  will  have  a  better  idea  as  to  what  type  (or  types) 
of  program (s)  actually  work"  (U.S.  Congress,  House  Committee  on 
Education  and  Labor,  1977s 4,  also  9;  hereafter  House  Report). 

While  the  Senate  version  stressed  bold,  New-Deal -like  solutions  tc 
the  problems  of  youth  employment,  the  hallmark  of  the  House  version  Wc 
"learning  what  works."  At  several  points  in  its  report  on  the  youth 
bill,  the  House  Committee  referred  to  the  uncertainty  of  expert  opinic 
about  youth  employment  (House  Report,  1977)  . 

Of  all  the  witnesses  that  appeared  before  the  Committee,  not 
one  had  a  definitive  answer  as  to  what  would  solve  the  problem 
of  chronic  youth  unemployment.  All  agreed  that  a  variety  of 
methods  should  be  tested  and  the  educational  system  should  be 
linked  with  whatever  approach  is  finally  agreed  upon. 

But  if  the  committee  was  emphatic  about  "finding  out  what  works," 
it  was  for  the  most  part  strategically  vague  about  what  that  meant. 
YIEPP  was  the  most  clearly  specified  of  the  House  proposals,  and  it 
left  considerable  ambiguity.  The  committee's  advice  about  what  it 
meant  by  "finding  out  what  works"  was  couched  in  the  following  terms 
(House  Report,  1977): 

In  placing  a  major  emphasis  ...  on  innovative  and 
demonstration  programs,  the  Committee  intends  that  a  broad 
range  of  activities  be  tested  ...  to  learn  what  works  to 
remedy  the  structural  nature  of  the  youth  employment  problem 
and  to  meet  the  employment  and  training  needs  of  specific 
target  groups  in  the  youth  population.  These  activities 
include  outreach,  counseling,  activities  promoting  education  to 
work  transition,  labor  market  information,  attainment  of  high 
school  equivalency,  job  sampling,  on-the-job  training, 
supportive  services,  programs  to  overcome  sex-stereotyping  in 
job  development  and  placement,  outreach  programs  for  minorities 
and  women  and  other  activities  designed  to  improve  the 
employability  of  youth. 

This  laundry  list  was  indicative  of  the  uncertainty  that  charac¬ 
terized  both  expert  opinion  and  political  judgment  about  the  youth 
employment  problem  and  its  solutions  in  1977  (see  Hahn,  1979)  .  There 
seemed  to  be  consensus  that  the  youth  unemployment  rate  was  too  high. 
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but  little  agreement  on  what  an  acceptable  rate  would  be.  There  was 
consensus  that  unemployment  was  borne  disproportionately  by  minority, 
especially  black,  youths,  but  little  understanding  of  the  relative 
importance  of  skills,  basic  education,  family  background,  and  dis¬ 
crimination  in  predicting  minority  youth  unemployment.  There  was 
consensus  that  the  time  was  ripe  for  political  action,  but  little 
confidence  in  past  solutions  to  youth  unemployment  and  little  specific 
agreement  on  what  would  constitute  success. 

Asked  whether  a  more  detailed  analysis  of  the  youth  employment 
problem  and  its  solutions  might  usefully  have  preceded  a  multi-billion 
dollar  demonstration  effort,  one  congressional  staff  member  replied, 

"Are  you  kidding?  When  you  get  the  kind  of  political  weight  behind  a 
proposal  that  this  one  had — Jackson,  Humphrey,  Randolph,  Javits, 

Hawkins — you  don't  say,  'Give  us  a  couple  of  years  and  we'll  come  up 
with  a  proposal.'  You  move.  Right  now!  You  go  with  what  you  have  and 
try  to  make  sense  of  it  as  you  go  along." 

Bill  Spring,  a  veteran  of  employment  legislation  as  a  Senate  staff 
member,  observed,  "We  were  coming  out  of  a  period  extending  from  the 
old  S— 1  [a  federal  manpower  bill]  in  1960,  through  the  Economic 
Opportunity  Act  of  1965,  up  to  CETA,  in  which  we  had  spent  huge  sums  of 
money  on  work  experience  for  the  unemployed  and  disadvantaged."  The 
evidence  was  now  pretty  clear  that  work  experience  had  the  smallest 
impact  of  anything  that  had  been  tried.  But  it  wasn't  clear  what  would 
work  better.  The  House's  uncertainty  was  well  founded. 

Nat  Semple  had  a  further  explanation  of  how  the  youth  proposals 
took  shape.  "When  you  ask  most  adults  what  to  do  about  any  problem 
with  young  people,  they  generalize  from  their  own  experience  and  from 
what  they  think  is  good  for  kids.  Congressmen  and  Senators  are  no 
different.  Some  of  them  thought  kids  ought  to  be  out  working  up  a 
healthy  sweat  in  the  country,  some  thought  they  ought  to  be  doing 
useful  public  deeds  around  town,  some  thought  they  ought  to  be  staying 
in  school,  some  thought  they  ought  to  be  getting  useful  training  to 
prepare  them  for  jobs.  The  bill  was  an  amalgamation  of  all  the  adult 
ideas  about  what's  good  for  kids." 

In  the  end,  the  Senate  conceded  reluctantly  to  the  House's 
demonstration  approach.  In  the  Conference  Report,  which  stated  the 
terms  of  compromise  between  the  House  and  Senate  versions,  the  Senate 
accepted  the  House's  language  stating  that  the  purpose  of  the  law  was 
the  "establishment  of  pilot,  demonstration  and  experimental  programs  to 
test  the  efficacy  of  different  ways  of  dealing  with  the  problem  of 
youth  unemployment,"  but  stipulated  that  the  statement  of  purpose  also 
contain  language  "specifying  that  a  variety  of  employment  and  training 
programs,  as  well  as  demonstration  programs,  are  authorized"  (U.S. 
Congress,  1977:35;  hereafter  Conference  Report).  As  is  usually  the 
case,  the  Congress  skirted  conflict  between  two  alternative  purposes  by 
opting  for  both. 

While  the  Congress  was  strategically  vague  on  the  issue  of  "learning 
what  works,"  it  was  more  specific  on  a  number  of  other  issues.  Both 
the  House  and  Senate  strongly  emphasized  the  need  to  pay  attention  to 
in-school  youths  and  the  lack  of  coordination  between  the  CETA  system 
and  the  educational  system  at  the  local  level.  The  Senate  took  the 


view  that  good  in-school  programs  and  strong  CETA-education  cooperatic 
were  "preventive  medicine"  against  the  more  difficult  problem  of  what 
to  do  about  school  dropouts  (U.S.  Congress,  Senate  Committee  on  Human 
Resources,  1977:10;  hereafter  Senate  Report).  The  Senate  saw  the 
set-aside  for  CETA-education  cooperation  as  the  solution  to  this 
problem.  The  House  observed  that  "perhaps  the  greatest  weakness  of 
most  of  the  youth  employment  proposals  that  have  been  introduced  in  th 
current  session  is  their  failure  to  place  any  emphasis  on  in-school 
youth  or  on  encouraging  out-of-school  youth  to  .  .  .  [return  to] 
school"  (House  Report,  1977:10).  The  House  saw  YIEPP  as  a  way  of 
speaking  to  this  problem. 

Another  issue  that  acutely  concerned  both  the  Senate  and  the  House 
was  the  wage  and  job  displacement  problem  for  adult  workers  that  was 
associated  with  youth  employment  measures.  Both  versions  included 
language  requiring  the  payment  of  prevailing  wages,  rather  than  the 
minimum  wage,  to  youths  filling  an  existing  position.  The  final 
version  contained  language  encouraging  prime  sponsors  to  take  the 
initiative  in  developing  new  and  restructured  job  classifications,  in 
cooperation  with  labor  organizations,  to  accommodate  youths.  The 
Conference  Report  stressed  that  the  wage  standards  in  the  law  "seek  tc 
promote  the  interests  of  both  youths  and  currently  employed  workers  an 
to  engage  prime  sponsors,  employers,  and  labor  organizations  in  a 
cooperative  effort  to  expand  opportunities"  (Conference  Report, 
1977:40) . 

A  related  issue  that  did  not  arise  explicitly  in  the  youth  employ¬ 
ment  bill,  but  lay  behind  it,  was  the  youth  subminimum  wage.  The  idea 
of  offering  employers  exemptions  from  the  minimum  wage  for  hiring 
youths  had  long  been  a  popular  conservative  proposal  for  addressing 
youth  unemployment.  It  was,  however,  anathema  to  labor  organizations 
and  liberal  legislators,  who  saw  it  as  a  mechanism  for  eroding  the 
minimum  wage  and  promoting  youth  displacement  of  adult  workers.  The 
Senate  and  House  versions  dealt  with  the  issue  by  diverting  attention 
away  from  it.  In  the  words  of  a  House  staff  member,  "A  major  advantac 
of  the  House  bill  was  that  it  temporarily  defused  the  youth  subminimuir 
wage.  Earlier  in  1977  a  youth  subminimum  amendment  to  the  Fair  Labor 
Standards  Act  had  failed  by  one  vote  in  the  House.  The  big  advantage 
of  the  House  bill  was  that  it  gave  Republicans  something  constructive 
to  vote  for  without  raising  the  youth  subminimum  again." 

Two  final  congressional  concerns  were  maintenance  of  const ituencie 
and  intragovernmental  coordination.  The  Department  of  Labor,  in  the 
administration  of  employment  and  training  programs,  had,  partly  by 
congressional  request  and  partly  by  its  own  initiative,  developed  a 
broad  network  of  working  relations  with  a  very  diverse  array  of  organi 
zations.  The  CETA  system  was,  of  course,  based  on  prime  sponsors — uni 
of  state  and  local  government  charged  with  responsibility  for  adminis¬ 
tering  federal  employment  and  training  funds.  Prime  sponsors,  and  the 
state  and  local  government  interest  groups  representing  them  (e.g.. 
National  Governors  Conference,  National  Conference  of  Mayors,  National 
Association  of  Counties)  ,  were  expected  to  play  a  key  role  in  any  new 
program. 


Prime  sponsors,  however,  delivered  only  a  fraction  of  CETA-funded 
services;  the  remainder  were  delivered  by  contractors,  some  locally 
based  community  groups,  some  affiliated  with  national  organizations 
(e.g..  Urban  League,  Opportunities  Industrialization  Centers),  many  of 
which  had  been  in  existence  since  the  emergence  of  federally  funded 
employment  programs  in  the  late  1950s.  These  community-based  organiza¬ 
tions  (CBOs)  were,  and  still  are,  an  important  part  of  the  political 
constituency  for  federal  employment  and  training.  Their  interests  were 
expected  to  be  represented  in  any  new  programs.  In  addition  to  these 
state  and  local  constituencies,  DOL  also  maintained  working  relations 
with  a  number  of  other  federal  agencies  through  a  variety  of  congres- 
sionally  mandated,  cooperatively  administered  programs.  Congress 
expected  all  these  working  relations,  plus  the  newly  mandated 
cooperative  arrangements  with  local  educational  systems,  to  be  carried 
over  into  the  administration  of  youth  employment  programs. 

These  expectations  were  stated  in  explicit  statutory  language.  The 
governors  were  given  their  own  set-aside  of  5  percent  of  total  YEDPA 
funding  for  exemplary  projects  and  coordinating  activities  at  the  state 
level.  The  secretary  of  labor  was  charged  with  implementing  "coopera¬ 
tive  arrangements  with  educational  agencies,"  including  "secondary 
schools,  postsecondary  educational  institutions,  and  technical  and 
trade  schools."  There  was  a  directive  to  "give  special  consideration" 
to  community-based  organizations,  such  as  "Opportunities  Industrializa¬ 
tion  Centers,  the  National  Urban  League,  SER-Jobs  for  Progress, 

Community  Action  Agencies,  union-related  organizations,  employer- 
related  non-profit  organizations,  and  other  similar  organizations." 

There  were  instructions  to  "consult,  as  appropriate,  with  the 
Secretary  of  Commerce,  the  Secretary  of  Health,  Education,  and  Welfare 
[later  Health  and  Human  Services] ,  the  Secretary  of  Housing  and  Urban 
Development,  the  Secretary  of  Agriculture,  the  Director  of  the  ACTION 
Agency,  and  the  Director  of  the  Community  Services  Administration." 

The  rationale  for  these  instructions  was  partly  political — assuring 
that  key  constituencies  would  be  included — and  partly  administrative — 
assuring  that  DOL  would  orchestrate  the  efforts  of  diverse  federal 
agencies.  In  the  words  of  Senate  aide  Richard  Johnson,  "The  idea  was 
that  someone  needed  to  pull  together  the  pieces  around  a  common  theme 
of  youth  employment." 

YEDPA,  then,  embodied  a  special  convergence  of  congressional 
interests.  It  authorized  bold  new  programs,  but  only  for  one  year  and 
only  as  part  of  the  general  CETA  authority  for  demonstration  projects. 

It  gave  DOL  a  broad  charge  to  "find  out  what  works"  and  substantial 
discretionary  resources  to  do  it,  but  tempered  that  grant  with  a  1-year 
authorization,  limited  guidance  about  what  to  focus  on,  and  a  reminder 
that  it  was  delivering  services  at  the  same  time  it  was  running  research 
and  demonstration  projects.  It  reminded  DOL  of  its  responsibilities 
for  maintaining  good  relations  with  federal,  state,  and  local  constitu¬ 
encies  in  the  process  of  mounting  new  programs.  It  clearly  signaled 
that  the  Congress  expected  increased  attention  to  in-school  youths  and 
to  the  connection  between  employment  and  training  programs  and  local 
educational  systems. 
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By  singling  out  youth  employment  for  special  attention,  though. 
Congress  was  significantly  shifting  its  expectations  for  the  employme 
and  training  delivery  system.  In  1973,  with  the  passage  of  CETA,  the 
Congress  had  altered  the  mode  of  delivery  for  employment  and  traininc 
programs  by  shifting  from  categorical  to  block  grants.  This  shift  ir 
federal  policy  meant  changing  from  a  system  in  which  the  federal 
government  gave  grants  directly  to  local  service  deliverers 
(community -based  organizations,  for  example)  to  a  system  in  which 
federal  funds  went  to  state  and  local  officials,  who  exercised 
substantial  administrative  control  over  the  allocation  of  federal  fur 
to  local  deliverers.  In  simple  terms  this  meant  a  dramatic  expansior 
in  the  administrative  complexity  of  the  employment  and  training 
system.  It  put  a  premium  on  the  indirect  management  of  local  deliver 
through  state  and  local  government  organizations  with  their  own 
political  constituencies. 

Under  the  previous  system,  youths  were  singled  out  for  attention 
categorical  programs,  notably  the  Neighborhood  Youth  Corps  and  the  Jo 
Corps.  After  CETA,  the  Job  Corps  and  the  Summer  Youth  Employment 
Program  remained  separately  authorized,  but  the  expectation  was  that 
state  and  local  governments  would  make  their  own  decisions  about  the 
appropriate  mix  of  youth  and  adult  programs  within  broad  guidelines  s 
by  the  federal  government.  An  important  part  of  the  rationale  for  th 
change  was  that  state  and  local  governments  knew  more  about  the  speci 
needs  of  their  areas  than  did  the  federal  government,  and  therefore, 
they  should  exercise  wide  discretion  in  the  use  of  federal  funds. 

With  the  passage  of  YEDPA,  CETA  prime  sponsors  saw  a  significant 
shift  in  federal  policy,  which  many  interpreted  correctly  as  a 
"recategorization"  of  federal  employment  and  training  programs.  Whil 
the  youth  programs  brought  new  money,  they  also  brought  increased 
federal  program  requirements,  reduced  flexibility,  political  stresses 
entailed  in  focusing  on  one  target  group  when  others  were  perceived  a 
equally  needy,  and  with  time,  a  more  active  management  role  from  the 
federal  Office  of  Youth  Programs. 

As  indicated  in  Table  4,  youths  continued  to  participate  at  a 
relatively  high  rate  in  "regular"  CETA  programs  at  the  same  time  the^ 
were  receiving  greater  attention  through  YEDPA.  This  led  many  state 
and  local  administrators  to  believe  that  young  people  were  receiving 
disproportionate  share  of  federal  funds.  Coupled  with  this  recategor 
zation,  prime  sponsors  were  also  confronted  with  the  demands  of  mount 
large  public  service  employment  programs  (see  Table  4) ,  participating 
in  other  DOL-initiated  research  and  demonstration  activities,  and 
responding  to  increased  DOL  demands  for  better  information  on  local 
decisions  and  their  effects.  Under  the  structure  of  indirect  manage¬ 
ment,  cooperation  of  state  and  local  governments  was  a  key  element  in 
the  success  of  any  federal  venture ,  but  singling  youths  out  for  speci 
attention  did  not  inspire  unqualified  state  and  local  support. 


TABLE  4  Participants  Under  Age  22  in  CETA  Programs  Other 
than  YEDPA,  1977-1981  (in  percentages) 


Program 

1977 

1978 

1979 

1980  1981 

Title  I, 

52 

49 

[ Movea 

to  Title  II,  B&C J 

Employment 

Training 

(1973-1978) 

Title  II, 

60 

21 

II-B&C, 

48 

48  45 

Public  Service 

employment 

Employment 

training 

(structural) 

II-D, 

23 

3  6  26 

public 

service 

employmen  t 
(structural ) 

Title  VI, 

64 

21 

22 

24  24 

Public  Service 
Employmen  t 
(cyclical) 

SOURCE:  Data  from  U.S.  Department  of  Labor  (1978-1982) . 


Executive  Branch  Perspective 

Within  the  executive  branch  at  the  federal  level,  expectations  for 
the  new  youth  employment  effort  were  quite  modest.  YEDPA  was  seen  as  a 
congressional  initiative.  The  Carter  administration  was  happy  to 
accommodate  it,  especially  insofar  as  it  dove-tailed  with  the 
President's  economic  stimulus  package.  But,  between  January  1977  and 
the  early  spring  of  1979,  the  administration  had  bigger  fish  to  fry. 

The  administration's  top  domestic  priorities  were,  first,  reducing 
unemployment  and  inflation,  and  second,  reforming  the  welfare  system. 

An  important  feature  of  the  economic  stimulus  program  was  publicly 
subsidized  employment.  The  economic  stimulus  package  provided  for  an 
increase  in  CETA-funded  public  service  employment  (PSE)  from  about 
300,000  to  725,000  people.  At  its  peak,  in  spring  1978,  over  750,000 
people  were  in  PSE  positions.  In  1979,  public  service  jobs  were 
reduced  to  under  600,000,  but  the  rapid  buildup  and  the  high  turnover 
of  PSE  participants  administered  a  severe  shock  to  the  CETA  system 
(U.S.  Department  of  Labor,  1978  and  1979;  hereafter  DOL) .  The  shock 
had  two  important  effects.  First,  it  focused  a  large  amount  of 
attention  at  the  local  level  on  finding  public  sector  jobs  to  create 
employment.  Second,  and  perhaps  more  importantly,  it  created  a 
permanent  and  indelible  notion  among  the  public  and  politicians  that 
CETA  was  a  public  employment  program,  not  an  employment  and  training 
program.  After  1977,  the  fate  of  CETA  would  hang  on  the  uses  and 
abuses  of  PSE,  not  on  its  less-visible  training  programs. 


The  hallmark  of  the  Carter  welfare  reform  package  was  the  use  of 
employment  to  reduce  welfare  dependency.  Called  the  Program  for  Betti 
Jobs  and  Income ,  the  proposal  promised  "to  provide  a  work  or  training 
opportunity  for  an  employable  adult  in  every  needy  family  that  includi 
a  child  under  age  18"  (DOL,  1978:123;  see  also  Lynn,  1981a).  This 
objective  was  to  be  achieved  by  coupling  welfare  benefits  with  work 
requirements  and  by  relying  on  the  employment  and  training  system  to 
absorb  large  numbers  of  welfare  beneficiaries.  Quite  apart  from  the 
political  difficulties  of  selling  such  a  proposal  and  the  practical 
difficulties  of  administering  it,  the  welfare  reform  proposal  posed  a 
gargantuan  job  of  interdepartmental  coordination  at  the  federal  level 

The  Department  of  Health,  Education,  and  Welfare  (HEW),  with  its 
prickly  and  combative  Secretary  Joseph  Califano,  considered  itself  to 
be  the  custodian  of  federal  welfare  policy.  The  Department  of  Labor 
(DOL)  saw  in  the  Carter  proposal  an  opportunity  to  become  a  central 
actor  in  a  large  new  policy  area.  The  White  House  Domestic  Policy 
Staff  was  saddled  with  the  role  of  orchestrating  this  complicated 
bureaucratic  minuet.  The  Carter  welfare  reform  proposal  eventually 
failed  to  get  congressional  approval,  but  not  before  it  had  consumed 
more  than  two  years  of  the  time  of  top  policy  staff  and  political 
leadership  within  the  administration. 

The  net  effect  of  these  two  domestic  priorities  on  the  youth 
employment  effort  was,  first,  to  push  YEDPA  into  the  background  withi 
DOL  and  the  executive  branch  generally,  and  second,  to  create  an  inte 
competition  between  YEDPA-funded  activities  and  other  CETA  activities 
at  the  local  level.  This  condition  persisted  until  early  1979,  when 
the  tide  began  to  turn.  During  the  1978  CETA  reauthorization  debate 
Congress,  there  was  an  ugly  and  protracted  discussion  of  local  misuse 
of  public  service  employment  funds,  which  had  serious  repercussions  f< 
CETA  and  its  political  supporters.  In  the  words  of  Bill  Spring,  Whit 
House  Domestic  Policy  Staff  member,  "We  came  within  an  inch  of  losing 
the  whole  thing." 

In  an  effort  to  refocus  attention  on  the  positive  side,  the  Depar 
ment  of  Labor  began  increasingly  to  emphasize  its  youth  employment 
efforts.  By  late  1978,  the  Carter  welfare  reform  proposal  had  gotten 
bogged  down  in  a  tangle  of  interdepartmental,  congressional,  and 
interest  group  fights  that  eventually  led  to  its  demise.  At  that 
point,  in  search  of  a  domestic  initiative  that  would  serve  to  focus 
positive  attention  on  the  administration  in  the  1980  election,  the 
White  House  staff  turned  to  youth  employment.  A  staff  member  within 
the  executive  branch,  who  was  a  persistent  critic  of  DOL's  youth 
employment  activities,  recalls  a  meeting  in  the  fall  of  1978.  "There 
was  a  proposal  floating  for  still  more  money  for  youth  employment,  an 
I  was  making  the  usual  arguments  against  it  with  Bill  Spring  when,  as 
I  recall,  Bert  Carp  [a  Domestic  Policy  Staff  member]  walked  into  the 
room  and  said,  'Youth  employment  is  going  to  be  the  administration's 
number  one  domestic  priority  in  the  1980  election. '  At  that  point,  I 
knew  the  discussion  was  over." 

In  late  1978,  the  President  appointed  the  Vice  President's  Task 
Force  on  Youth  Employment,  chaired  by  then-vice  President  Walter 
Mondale,  and  charged  it  with  developing  a  new  youth  initiative.  In 
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roughly  18  months,  then,  youth  employment  moved  from  being  a  back- 
burner,  congressionally  initiated  enterprise  to  being  a  top  domestic 
priority  in  the  Presidents  bid  for  reelection,  and  the  administra¬ 
tion’s  only  new  domestic  initiative.  These  shifting  expectations  were 
to  have  significant  effects  on  the  administration  of  YEDPA. 


DESIGN  OF  KNOWLEDGE  DEVELOPMENT  EFFORT 

The  administration  lost  little  time  in  responding  to  the  congres¬ 
sional  youth  initiative.  In  July  1977,  before  YEDPA  had  been  signed  by 
the  President,  Secretary  Marshall  created  the  Office  of  Youth  Programs 
(OYP)  within  the  Employment  and  Training  Administration  (ETA)  and 
appointed  Robert  Taggart  to  be  its  administrator.  The  new  OYP  was 
allocated  49  positions  to  carry  out  its  charge;  of  these,  16  were 
existing  Job  Corps  positions,  and  27  of  the  remaining  33  positions  were 
"mandatory  hires,"  or  transfers  from  other  parts  of  DOL,  over  which  the 
new  administrator  had  no  control.  This  left  Taggart  with  6  positions 
to  fill.  Of  the  total  OYP  positions,  14  were  allocated  to  research, 
demonstration,  and  evaluation,  and  the  remainder  were  allocated  to 
program  administration. 

The  magnitude  of  the  task  confronting  Taggart  was  extraordinary. 

The  final  terms  of  the  congressional  charge  involved  roughly  doubling 
the  size  of  the  Job  Corps,  as  well  as  enriching  the  program’s  education 
and  training  components;  increasing  the  Summer  Youth  Employment  Program; 
launching  the  Youth  Incentive  Entitlement  Pilot  Projects,  a  $200- 
million-plus ,  multi-site  demonstration;  launching  three  new  operating 
programs — YCCIP,  YACC,  and  YETP;  and,  most  importantly,  deciding  how  to 
use  the  discretionary  funding  allocated  to  the  secretary  under  the 
terms  of  YEDPA. 

It  was  from  the  last  of  these — discretionary  funding — that  the 
"knowledge  development  agenda"  grew.  The  YEDPA  funding  formula  was  of 
byzantine  complexity;  it  began  by  taking  the  total  appropriation  for 
YIEPP,  YCCIP,  and  YETP  and  dividing  it  into  three  parts:  15  percent 
went  to  YIEPP,  15  percent  to  YCCIP;  and  the  remaining  70  percent  to 
YETP.  YACC  was  funded  separately.  Of  the  70  percent  allocated  to 
YETP,  three-quarters  went  by  formula  to  prime  sponsors;  the  remaining 
one-quarter,  after  some  small  deductions  for  special  allocations  to 
states,  and  set-asides  for  migrant  workers  and  native  Americans,  went 
to  the  secretary  for  discretionary  allocations.  Depending  on  appro¬ 
priation  levels  and  how  one  defined  "discretionary,"  this  formula  would 
deliver  between  $300  and  $500  million  in  discretionary  money  to  OYP  in 
fiscal  1978,  1979,  and  1980.  The  low  end  of  this  range  included  only 
those  funds  authorized  for  discretionary  allocation  under  the  formula; 
the  high  end  included  YIEPP,  which  had  to  be  used  for  a  specific 
programmatic  purpose,  but  which  could  be  allocated  at  the  discretion  of 
the  secretary. 

The  term  "discretionary"  was  deliberately  ambiguous.  As  noted 
earlier.  Congress  viewed  discretionary  funds  as  a  way  of  adjusting 
formula  allocations  to  constituency  interests  and  congressional 
expectations.  With  the  implementation  of  YEDPA,  however,  the  term 


"discretionary"  became  synonymous  with  the  knowledge  development  agenc 
This  change  in  emphasis  was  the  result  of  Taggart 8 s  initiative,  not  tl 
explicit  direction  of  Congress. 

While  Congress's  intent  was  to  "find  out  what  works,"  and  dis¬ 
cretionary  funds  were  clearly  to  play  a  major  role  in  meeting  that 
intent,  it  was  by  no  means  a  foregone  conclusion  that  the  use  of 
discretionary  funds  would  be  organized  around  a  centrally  administerec 
research  and  development  agenda.  The  House's  expectations  were  that 
YIEPP  would  be  run  as  a  multi-site  demonstration  and  that  the  remainde 
of  YEDPA  would,  in  a  House  staff  member's  words,  be  allocated  on  the 
principle  of  "let  a  thousand  flowers  bloom."  According  to  Senate  aide 
Richard  Johnson,  "Knowledge  development  was  Bob  Taggart's  method  for 
bringing  some  sort  of  order  out  of  the  collection  of  programs  he  had  t 
administer.  In  fact,  we  had  an  embarrassing  interlude  with  Bob  right 
after  the  bill  passed  when  word  got  back  to  the  Hill  that  he  was 
calling  YEDPA  a  'disorganized  hodge-podge'  of  programs — a  little 
insensitive  to  the  Members'  interests.  To  his  credit,  though,  he 
seized  the  initiative.  He  saw  the  discretionary  money  as  an 
opportunity  to  be  innovative  and  systematic,  and  pull  things  together 
under  a  larger  strategy.  That  was  all  right  by  us." 


Centralizing  Control  of  YEDPA  in  OYP 

Within  DOL,  it  was  far  from  a  foregone  conclusion  that  OYP  would 
control  all  program  operations,  research,  development,  and  evaluation 
activities  associated  with  YEDPA.  There  were  at  least  three  alter¬ 
natives  to  this  model.  The  usual  approach  would  have  been  for  the 
secretary  to  delegate  operating  authority  to  OYP  and  responsibility  fc 
research,  development,  and  evaluation  to  the  Office  of  Policy  Evaluate 
and  Research  in  the  Employment  and  Training  Administration  or  jointly 
to  OPER  and  to  the  Office  of  the  Assistant  Secretary  for  Policy 
Evaluation  and  Research  in  the  Office  of  the  Secretary. 

Another  alternative  would  have  been  to  allocate  the  bulk  of  the 
discretionary  money  to  prime  sponsors  under  a  series  of  large-scale 
grant  competitions,  and  then  to  require  the  recipients  of  those 
grants — state  and  local  agencies — to  develop  research  and  evaluation 
plans  and  relations  with  research  and  evaluation  organizations  as  pari 
of  their  projects.  A  third  option  might  have  been  for  OYP  and  OPER 
jointly  to  develop  plans  for  a  limited  number  of  large-scale  demonstrc 
tions  or  social  experiments,  along  the  lines  suggested  by  YIEPP,  to 
manage  those  projects  jointly,  and  to  contract  with  external  organiza¬ 
tions  to  evaluate  the  projects. 

The  decision  to  locate  all  responsibility  for  program  operations, 
research,  development,  and  evaluation  in  OYP  was  taken  at  Taggart's 
initiative.  "No  money  is  ever  really  'discretionary,'"  Taggart  said. 
"It's  all  got  to  be  used  to  serve  a  variety  of  missions — political, 
administrative,  and  research.  The  question  was  how  much  control  woult 
we  exercise  over  the  discretionary  money  and  whether  we  would  divide  j 
up  within  the  Department.  There  were  a  number  of  people  who  wanted  t< 


put  it  all  out  by  administrative  formula  to  prime  sponsors?  even 
Entitlement  could  have  been  sent  out  on  a  modified  formula  basis.  I 
got  a  quick  sign-off  [from  the  secretary]  immediately  tying  it  all  up 
[ in  OYP] . " 

Taggart's  aggressiveness  in  seizing  control  of  the  discretionary 
funds  did  not  endear  him  to  others  in  DOL,  but  neither  did  it  create 
serious  bureaucratic  problems.  "The  scale  of  this  thing  [YEDPA]  was 
unlike  anything  the  department  had  ever  done,"  Taggart  argues.  "ORD 
[the  Office  of  Research  and  Development,  the  unit  within  OPER  with 
responsibility  for  demonstrations]  had  a  budget  of  around  [$20]  million 
a  year.  We  were  talking  about  putting  something  like  $200  million  out 
in  the  first  year.  The  existing  structure  just  wasn't  designed  to  do 
that."  While  others  within  DOL  perceived  Taggart  as  aggressive,  brash, 
and  abrasive,  they  did  not  actively  oppose  his  design  to  control 
discretionary  funding  after  the  secretary's  approval  and,  in  fact, 
assisted  him  in  certain  ways.  Howard  Rosen,  then  head  of  ORD,  and 
Seymour  Brandwein,  then  head  of  OPE  (Office  of  Policy  Evaluation,  the 
other  branch  of  OPER) ,  worked  with  Taggart.  Rosen  helped  OYP  in 
contracting  for  outside  services?  Brandwein  offered  advice  on  research 
questions  and  negotiating  the  DOL  bureaucracy.  One  ORD  staff  member, 
speculating  about  why  Rosen  did  not  fight  for  more  control  of  YEDPA 
discretionary  funds,  said,  "I  think  Rosen  .  .  .  saw  YEDPA  as  more  of  an 
institutional  capacity,  delivery,  building  effort  and  thus  didn't  see 
it  as  a  proper  ORD  effort."  The  same  relationship  held  with  ASPER,  in 
the  Office  of  the  Secretary.  Robert  Lerman,  then  an  ASPER  staff 
member,  recalls,  "ASPER  was  much  more  preoccupied  with  welfare  reform, 
PSE,  and  [the]  Humph rey-Hawk ins  [full  employment  proposal]  than  with 
youth  employment?  the  youth  programs  were  less  than  highest  priority, 
and  because  of  that  Taggart  was  given  much  freer  rein." 

Taggart  used  another  device  to  solidify  his  position  within  DOL. 

He  contracted  with  OPER  and  ASPER  to  carry  out  pieces  of  the  knowledge 
development  agenda.  ASPER  was  given  money  to  conduct  basic  research  on 
the  nature  of  the  youth  employment  problem,  which  it  used  to  contract 
for  a  number  of  studies.  OPER,  in  addition  to  helping  with  contracting, 
was  given  funds  to  extend  two  major  longitudinal  surveys  to  provide 
more  detailed  coverage  of  youth  problems  and  to  fund  other  youth- 
related  activities.  OPER,  on  its  own,  also  conducted  an  extensive 
evaluation  of  the  Job  Corps  and  an  assessment  of  YEDPA  implementation 
by  local  prime  sponsors. 

By  establishing  this  relationship  Taggart  deflected  any  oversight 
they  may  have  conducted  on  his  research  and  development  activities. 
According  to  ASPER' s  Lerman,  "Our  relationship  with  OYP  tied  us  up  a 
little  bit.  It's  kind  of  hard  to  fully  oversee  another  operation  when 
you  can't  even  spend  your  own  money.  We  were  all  understaffed  and  that 
worked  to  Bob's  advantage.  Besides,  Bob  is  a  doer?  he  doesn't  wait,  he 
acts.  He  just  took  control  and  pushed  ahead,  and  no  one  was  there  to 
tell  him  otherwise."  These  sentiments  were  endorsed  by  an  OPER 
administrator,  who  said,  "We  were  reluctant  to  take  on  new  responsi¬ 
bilities  beyond  our  capacity  or  to  get  into  wrangling  with  Taggart, 
with  whom  [many  of  us]  agreed  anyway." 
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Taggart's  tactics  for  dealing  with  ASPER  and  OPER  also  avoided  a 
chronic  organizational  problem  that  DOL  had  been  grappling  with  as 
early  as  1973.  ASPER  was  staffed  mainly  by  economists,  who  usually 
took  short-term  appointments  of  two-to-four  years,  often  on  leave  fr 
academic  appointments,  and  whose  main  interest  was  the  application  o 
economic  analysis  to  policy  decisions  at  the  departmental  and 
presidential  level.  OPER,  on  the  other  hand,  was  staffed  mainly  by 
career  civil  servants  whose  background  was  in  employment  programs  an 
whose  main  interest  was  the  program  monitoring  and  evaluations  aimed 
improving  operations.  These  institutional  loyalties  tended  to  reinf 
mutual  stereotypes  within  the  department,  not  always  accurate,  that 
ASPER  was  populated  by  "academic  economists”  and  OPER  by  "program 
people . " 

Another  characterization  of  the  difference,  offered  by  an  OPER 
administrator,  was  that  the  "academics  believed  that  conceptualizing 
evaluation  was  the  key  issue  .  .  .  with  little  regard  for  feasibilit; 
or  .  .  .  implementation."  The  split  resulted  in  delay  and  disagreenu 
around  the  planning  for  the  national  evaluation  of  CETA  in  1974 
(Hargrove  and  Dean,  1980).  A  major  effect  of  Taggart's  move  to 
centralize  program  operations,  research,  development,  and  evaluation 
OYP,  then,  was  to  avoid  a  major  source  of  past  institutional  conflic 
within  DOL. 

Another  possible  source  of  external  scrutiny  over  OYP  might  have 
been  the  Office  of  Management  and  Budget  (OMB)  in  the  Executive  Offi< 
of  the  President,  which  monitors  the  research  and  evaluation  activit 
of  federal  agencies.  The  OMB  examiner  for  YEDPA,  a  critic  of  OYP's 
knowledge  development  efforts,  explains  why  OMB  exercised  little 
influence  or  oversight:  "I  came  on  board  just  after  YEDPA  passed, 
was  clear  that  Taggart  was  unwilling  to  take  any  outside  advice  he 
didn't  agree  with.  No  one  within  DOL  was  willing  to  try  to  corral 
him.  It  was  a  clear  case  of  institutional  default.  From  OMB 1  s  poin 
of  view,  if  the  money  comes  to  the  agency  from  Congress  on  a  set-asi< 
basis,  we  have  no  direct  way  to  reach  it.  We  stay  out  of  the  sec¬ 
retary's  internal  business  and  focus  on  the  budget  and  the  President 
program.  We  are  not  in  a  position  to  tell  people  in  the  departments 
what  kind  of  research  to  do?  we  can  try  to  cajole  and  persuade,  but  \ 
don't  have  much  influence.  One  thing  is  for  sure,  though.  Allowing 
Taggart  to  grab  control  of  the  discretionary  money  was  a  very 
significant  decision;  once  that  happened,  we  all  lost  our  ability  to 
influence  what  was  going  on." 

Taggart,  not  surprisingly,  saw  the  stakes  differently.  "We  had 
enormous  resources,  basically  no  staff,  multiple  objectives,  and  ver; 
little  time.  People  in  the  department  didn't  pay  much  attention  to 
they  were  consumed  by  PSE.  We  ended  up  being  the  only  program  in  th 
department  combining  policy,  research,  and  operations.  The  law  said 
first,  get  the  money  to  people  in  the  right  places,  second,  achieve 
some  kind  of  coordination  between  federal  agencies — take  a  leading 
role,  and  third,  do  something  about  the  relationship  between  schools 
and  employment  programs.  The  research  focus  was  my  way  of  exercisin 
administrative  control.  My  view  of  the  purpose  was  to  establish  an 
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institutional  base  for  youth  employment  programs  and  make  it  work  to 
serve  youths.  You  had  to  achieve  large-scale  institutional  change,  and 
the  way  to  do  that  was  to  put  the  money  out  there  and  then  use 


monitoring,  evaluation,  demonstration, 
along . " 


and  research  to  pull  the  system 


In  other  words,  centralized  control  was  Taggart 8 s  way  of  putting 
research  into  the  service  of  management.  "Finding  out  what  works"  was 
useful  only  insofar  as  it  was  instrumental  in  building  a  structure  of 
institutions  focused  on  youth  employment. 

Taggart  was  young  in  his  thirties — relatively  inexperienced  as  an 
administrator,  very  ambitious,  and  possessed  of  strong  ideas  about  the 
role  of  research  in  policy  making  and  administration.  His  major  experi¬ 
ence  before  coming  to  OYP  had  been  as  a  researcher,  having  worked  with 
Sar  Levitan  on  a  number  of  studies  of  federal  employment  and  poverty 
programs.  From  his  prior  work  and  his  early  experience  in  DOL,  he 
evolved  some  working  principles.  One  of  these  was  that  all  program 
effects  are  marginal.  "Whatever  we  deliver  as  a  program  is  one  of  many 
factors  operating  on  kids,  and  not  the  most  important  one  at  that.  The 
best  you  can  expect  is  a  10  percent  effect.  You  can  never  separate 
participant,  site,  and  program  effects." 


Another  principle  was  deep  skepticism  about  employment  research  and 
the  researchers  who  produce  it.  "The  problem  with  the  research  com¬ 
munity  is  that  they  don't  know  substance,  institutions,  and  procedures-- 
most  employment  research  is  useless  if  you  need  to  figure  out  what  to 
do  [with  it]."  This  skepticism  about  research  was  matched  by  an  equal 
skepticism  about  the  competence  and  knowledge  of  the  people  who  operate 
employment  programs.  "You  can't  rely  on  practitioners  to  find  the 
solutions.  .  .  .  Their  perspective  is  too  narrow."  A  final  principle. 


which  evolved  with  experience,  was  that  the  content  of  the  program  was 
less  important  in  determining  outcomes  than  the  skill  with  which  the 
program  was  implemented.  "Everything's  good  that's  done  good." 

Together,  these  principles  comprised  an  instrumental  view  of  the 
relationship  among  research,  evaluation,  management,  and  policy.  The 
purpose  of  research  and  evaluation  was  not  simply,  or  even  primarily. 


to  inform  policy  decisions.  It  was  to  create  a  management  structure,  a 
structure  for  judging  and  rewarding  performance,  for  developing  pro¬ 
grams,  for  dispensing  money  and  assistance,  and  for  weeding  out 
ineffective  practices  and  replacing  them  with  effective  ones.  You 
couldn't  evaluate  until  the  institutional  structure  was  there  to 
develop  and  implement  a  program,  whatever  was  implemented  was  highly 
dependent  on  the  limited  skills  of  the  people  who  worked  in  the 
delivery  system.  The  function  of  research  and  evaluation  was,  first, 
to  create  a  management  structure  and,  second,  to  nudge  local  adminis¬ 
trators  by  stages  into  better  performance.  From  this  perspective, 
separating  the  research,  development,  and  evaluation  purposes  of  YEDPA 
from  its  programmatic  purposes  would  have  been  unthinkable.  For 
Taggart,  research,  development,  and  evaluation  were,  primarily,  tools 
of  management  and,  secondarily,  mechanisms  for  systematic  inquiry  or 


policy  making. 


The  Knowledge  Development  Plans 


The  first  attempt  to  design  the  research,  development,  and 
evaluation  component  of  YEDPA  was  embodied  in  the  1978  Knowledge 
Development  Plan,  written  soon  after  Taggart  became  administrator  of 
OYP.  The  term  "knowledge  development"  is  credited  to  Joe  Seiler,  a 
veteran  of  OPER  and  an  assistant  to  Taggart  (DOL,  1980es9).  This  fir£ 
knowledge  development  plan  was,  in  Taggart’s  words,  a  "seat-of-the- 
pants"  document,  crafted  from  two  sources.  "First,  we  took  the  law  ar 
broke  it  into  pieces  that  were  consistent  with  congressional  intent. 
Next,  I  gave  my  best  reading  of  the  issues  in  youth  policy  that  had 
developed  since  the  60s." 

The  body  of  the  1978  plan  closely  followed  the  structure  of  YEDPA 
and  its  funding  formula.  It  included  descriptions  of  research, 
development,  and  evaluation  activities  to  be  undertaken  in  each  of  th< 
mandated  programs — YACC,  YIEPP,  YCCIP,  and  YE TP — and  a  careful  statem€ 
of  how  those  activities  would  correspond  to  congressional  expectations 
The  plan  also  contained  the  first  list  of  eight  cross-cutting  research 
issues  (Table  5) .  This  list  later  evolved  into  15  questions  (Table  6] 
and,  in  the  1979  plan,  into  16  issues. 

The  first  plan  was  mute  on  the  practical  question  of  how  those 
broad,  cross-cutting  questions  would  be  answered  by  the  specific 
studies  taking  place  under  each  congressionally  mandated  program.  Th< 
1979  plan  made  the  conceptual  connections  between  broad  issues  and 
specific  studies  clearer  by  organizing  specific  studies  around  broadei 
issues,  keyed  to  time  lines  (DOL,  1980c).  But  throughout  the  plans 
there  was  no  explicit  discussion  of  who  would  draw  disparate  studies 
together  and  how  that  would  be  done. 

The  fact  that  these  issues  were  left  unspecified,  however,  did  nol 
mean  that  Taggart  had  no  solutions  to  them.  One  solution  was  to 
contract  with  an  outside  research  organization,  the  Center  for 
Employment  and  Income  Studies  (CEIS;  later  consolidated  into  the  Cent€ 
for  Human  Resources)  at  Brandeis  University,  to  help  OYP  exercise 
lateral  influence  over  the  design  of  evaluations  in  separate  projects 
and  to  help  synthesize  results.  But  the  primary  solution,  for  Taggarl 
was  that  he  understood  connections  among  pieces  of  the  design.  On  th] 
matter,  Taggart  is  unapologetic.  "I’m  the  only  one  who  knows  how  the 
pieces  of  the  process  fit  together  because  I’m  the  one  who  designed  il 

The  practical  problems  of  mounting  a  large-scale  research  and 
development  enterprise  were  another  major  theme  in  the  knowledge 
development  plans — problems  of  management,  organization,  time,  and 
methodology.  The  main  management  problem  was  how  to  mount  good 
demonstration  programs  without  "locking  resources  into  an  operational 
mode  such  that  it  would  be  difficult  to  transfer  them  in  the  future  tc 
approaches  which  prove  more  effective."  Another  management  problem  w< 
that  YEDPA  was  intended  to  provide  jobs  as  well  as  research  on  what 
works,  which  created  "a  tradeoff  between  careful  research  design  and 
rapid  implementation  to  maximize  economic  impacts."  The  main 
organizational  problem  was  limited  staff  at  the  federal,  regional,  an< 
local  levels  and  "resources  scattered  over  myriad  projects." 
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TABLE  5  Research  Questions,  1978  Knowledge  Development  plan 


1.  Does  school  retention  and  completion  increase  the  future 
employability  of  potential  dropouts  and  the  disadvantaged,  and  is 
subsidized  employment  a  mechanism  for  increasing  school  retention  and 
completion? 

2.  Can  the  school-to-work  transition  process  be  improved?  This 
involves  several  related  questions.  Are  new  institutional  arrangements 
feasible  and  warranted?  Will  increased  labor  market  information  and 
assistance  expedite  the  transition?  Can  employer  subsidies  and  other 
private  sector  approaches  create  new  transition  routes? 

3.  Work  experience  has  become  the  primary  emphasis  of  youth 
programs.  Jobs  are  to  be  "useful"  and  "meaningful,"  i.  e . ,  having  both 
a  worthwhile  output  and  an  impact  on  future  careers.  Are  the  jobs 
productive?  Which  ones  are  most  "meaningful"  and  how  can  they  be 
identified? 

4.  Does  structured,  disciplined  work  experience  have  as  much  or  more 
impact  on  future  employability  than  other  human  resource  development 
services  or  a  combination  of  services  and  employment? 

5.  Are  there  better  approaches  or  delivery  mechanisms  for  the  types 
of  career  development,  employment,  and  training  services  which  are 
currently  being  offered? 

6.  To  what  extent  are  short-run  interventions  and  outcomes  related  to 
longer-term  impacts  during  adulthood?  Put  in  another  way,  how  do 
public  interventions  affect  the  maturation  and  development  process? 

7.  What  works  best  and  for  whom?  This  is  a  perpetual  and  critically 
important  question  of  matching  services  with  needs.  To  answer  this,  it 
is  first  necessary  to  develop  a  set  of  performance  or  outcome  standards 
which  determine  what  does  and  does  not  work.  The  second  step  is  to  try 
to  determine  who  realizes  these  benefits  under  which  programs  and 
approaches . 

8.  What  are  the  costs  of  fully  employing  youths?  Unemployment  rates 
for  youths  are  of  questionable  meaning  because  of  the  substantial 
number  of  "discouraged"  individuals  who  are  outside  the  labor  force  but 
would  be  attracted  to  minimum-wage  jobs.  Others  are  working  less  than 
the  desired  number  of  hours.  It  is  important  to  determine  the  extent 
of  the  job  deficit  and  the  costs  of  eliminating  it. 


SOURCES  U.S.  Department  of  Labor  (1980b) . 


TABLE  6  Knowledge  Development  Research  Questions,  1979-1980 


1.  Does  school  retention  and  completion  increase  the  future  employaoil. 
of  potential  dropouts  and  the  disadvantaged,  and  are  employment  and  trair 
services  linked  to  education  an  effective  mechanism  for  increasing  scnoo. 
rentention  and  completion? 

2.  Can  the  school-to-work  transition  process  be  improved?  This  involv< 
several  related  questions.  Are  new  institutional  arrangements  feasible  t 
warranted?  Will  increased  labor  market  information  and  assistance  exped; 
the  transition?  Can  new  transition  routes  be  created? 

3.  Given  the  fact  that  work  experience  has  become  tne  primary  emphasis 
youth  programs,  are  the  jobs  productive,  which  ones  are  most  "meaningful' 
how  can  they  be  improved? 

4.  Does  structured,  disciplined  work  exprience  have  as  much  or  more  imj 
on  future  employability  than  other  human  resource  development  services  or 
combination  of  services  and  employment,  i.  e.,  should  public  policy  emphi 
straight  work  experience,  combinations  of  work  and  training  and  other 
services,  or  should  training,  education,  and  supportive  services  r>e 
emphasized? 

5.  Are  there  better  approaches  and  delivery  mechanisms  for  the  types  oj 
career  development,  employment,  and  training  services  which  are  currently 
being  offered? 

6.  To  what  extent  are  short-run  interventions  and  outcomes  related  to 
longer-term  impacts  on  employability  during  adulthood?  Put  in  another  wa 
how  much  can  public  interventions  redirect  the  developmental  process? 

7.  What  works  best  for  whom?  What  performance  or  outcome  standards  are 
best  to  determine  what  does  and  does  not  work  for  youths?  Which  youtns  v 
what  characteristics  benefit  from  which  programs  and  approaches? 

8.  What  is  the  universe  of  need  for  youth  programs?  What  is  the  cost  c 
fully  employing  youths?  How  many  would  take  jobs  if  they  were  available 
how  many  nours  of  employment  do  they  require? 

9.  What  approaches  and  procedures  can  be  used  to  involve  the  private  se 
in  employment  and  training  efforts  ana  to  increase  tne  placement  of  the 
participants  in  private  sector  jobs?  How  effective  are  those  approaches 
accessing  new  jobs  and  providing  better  career  tracks  tor  youtns?  Are  t! 
preferable  to  public  sector  approaches? 

10.  What  is  the  best  mix  of  enrollees  in  terms  of  age  ana  income  status: 
Will  poor  youths  benefit  from  interaction  with  nondisadvantaged  youths  or 
with  older  persons?  Is  targeting  achieved  and  is  it  a  worthwhile  notion': 

11.  What  arrangements  can  be  made  to  increase  the  duration  of  employment 
training  interventions  and  to  assure  that  participants  realize  lifetime 
benefits?  Will  youths  demonstrate  the  commitment  and  consistency  to  make 
these  long-term  investments  pay  off? 


TABLE  6  (Continued) 


12.  What  strategies  are  most  important  at  different  points  in  the  lives  of 
youths?  Must  training  be  delayed  until  greater  maturity  is  achieved?  Are 
employment  and  training  programs  a  way  of  inducing  maturity? 

13.  How  can  separate  youth  programs  be  better  integrated  to  improve 
administration  and  to  provide  more  comprehensive  services  to  youths?  To  wnat 
extent  are  the  programs  already  integrated  at  the  local  level? 

14.  How  do  the  problems  of  significant  youth  segments  differ,  including 
those  of  migrants,  rural  youths,  the  handicapped,  offenders,  young  women  with 
children,  runaway,  and  the  like?  Are  special  needs  groups  and  special 
problems  better  handled  by  mainstreaming  or  by  separate  programs  for  those 

g  roups? 

15.  How  can  the  lessons  from  knowledge  development  activities  best  be 
transferred  to  improve  existing  youth  programs?  How  can  the  institutional 
change  process  be  promoted?  What  are  the  learning  curves  on  new  programs  and 
how  much  can  they  be  expected  to  improve  with  time? 


SOURCE:  U.S.  Department  of  Labor  (1980a) . 


The  main  problem  with  time  initially  was  that,  with  the  exception 
of  YACC,  YEDPA  programs  were  authorized  only  through  October  of  1978. 
This  meant  that,  while  many  research  questions  required  long-term 
studies,  commitments  could  only  be  made  for  one  year.  After  October 
1978,  when  YEDPA  was  reauthorized  through  1980,  there  were  additional 
demands  to  provide  timely  results,  through  the  summer  and  fall  of  1979, 
for  the  policy  development  effort  operating  under  the  Vice  President's 
Task  Force  for  Youth  Employment,  which  culminated  with  a  proposal  to 
the  Congress  in  January  of  1980.  The  main  methodological  problem  was 
how  to  devise  studies  that  could  provide  verifiable  results  within  the 
constraints  of  program,  organization,  and  time  (DOL,  1980c) . 

A  sense  of  how  time  constraints  drove  design  decisions  can  be 
gleaned  from  the  1979  Knowledge  Development  Plan  (DOL,  1980b:lll): 

Three  of  the  four  major  YEDPA  programs — YETP,  YCCIP,  and  YIEPP — 
are  authorized  only  through  fiscal  1980.  It  is  anticipated 
that  by  that  time  many  of  the  critical  issues  underlying  youth 
policy  will  be  resolved  to  a  greater  degree  so  that  major 
decisions  can  be  made.  For  recommendations  to  be  formulated 
and  legislation  passed  by  the  end  of  fiscal  1980,  these  must  be 
based  on  results  which  will  be  available  at  the  latest  by  fall 
of  1979. 

The  .  .  .  schedule  for  the  implementation  of  1979  discretionary 
activities  makes  it  quite  apparent  that  there  will  only  be 
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limited  information  from  these  projects  by  this  time.  Even  on 
a  rapid  implementation  schedule,  most  will  not  complete  a 
design  and  contracting  until  the  end  of  the  first  quarter  of 
fiscal  1979.  The  results  of  the  first  half  year's  operations 
can  hardly  be  tabulated  and  analyzed  by  the  end  of  1979  and 
only  interim  process  findings  will  be  available  reflecting 
mainly  start-up  difficulties.  Most  of  the  information  yield 
for  the  end-of-1979  decisions  will  have  to  come  from  projects 
implemented  in  fiscal  1978.  Here  too,  the  findings  are  limited 
to  early  results  and  developments  rather  than  long-term  impacts. 

A  less  ambitious  and  committed  person  than  Taggart  would  have  conclud 
from  this  analysis  that  congressional  and  executive  expectations  for 
results  from  YEDPA  were  simply  incompatible  with  time  and  resource 
constraints.  Taggart  did  not  draw  this  conclusion:  Whatever  could  b 
produced,  would  be  produced. 


Key  Design  Features 

As  the  knowledge  development  strategy  evolved,  certain  design 
features  emerged.  Among  these  were  (1)  complexity  in  the  range  of 
issues,  program  activities,  research  projects,  and  products;  (2) 
relatively  heavy  emphasis,  in  early  phases,  on  process  information, 
rather  than  outcome  data;  (3)  wide  variability  in  research  design, 
method,  and  type  of  results  from  one  knowledge  development  activity  t 
another;  and  (4)  major  changes  over  time. 

The  knowledge  development  plans  were  complex  largely  because  the 
congressional  and  executive  expectations  that  accompanied  YEDPA  were 
complex.  Granting  the  complexity  of  expectations,  though,  a  common 
theme  among  both  Taggart's  harshest  critics  and  strongest  allies  was 
that  he  did  little  to  control  the  complexity  of  the  enterprise.  Robe 
Lerman,  ASPER  staff  member,  recalls  that  in  late  1978,  when  Taggart 
convened  a  conference  at  Reston,  Virginia  to  discuss  knowledge  develc 
ment  efforts,  "It  struck  me  that  the  plan  just  had  too  many  questions 
He  [Taggart]  listened  carefully  to  people's  reservations  and  he  thouc 
about  the  problems  they  raised,  but  early  on  he  bought  into  a  big 
multi-demonstration  view  of  what  he  was  doing,  which  didn't  accommodc 
much  to  clarity  in  design.  Things  didn't  seem  to  have  a  clear  logica 
structure  to  them." 

Andrew  Hahn,  who  worked  with  Leonard  Hausman  in  the  Brandeis  Cent 
for  Employment  and  Income  Studies  as  part  of  the  technical  assistance 
function  of  OYP,  recalls,  "Len  Hausman  argued  that  the  first  plan  was 
too  complex.  He  said  it  could  be  organized  around  three  aspects  of  t 
youth  labor  market — labor  supply,  or  how  to  affect  the  skills  and 
attributes  that  kids  bring  to  employers;  labor  demand,  or  how  to 
influence  employers'  demand  for  kids  through  various  kinds  of 
incentives;  and  intermediary  linkages,  or  how  to  smooth  out  the 
transition  to  the  work." 

Taggart  resisted  this  advice.  "There  were  probably  two  reasons  v 
he  resisted,"  Hahn  continues.  "First,  he  had  a  hard  time  prioritizin 


Bob  always  thought  in  long,  complicated  lists,  rather  than  in  simpler 
frameworks.  Also,  it  may  have  been  that  he  deliberately  wanted  an 
inelegant  design;  by  keeping  the  agenda  complex,  he  maintained  control 
and  kept  [Arnold]  Packer  [assistant  secretary  for  policy,  evaluation, 
and  research],  Brandwein,  Rosen  [from  OPER] ,  and  the  White  House  off 
his  back."  The  net  result  of  this  complexity,  says  Hahn,  who  is  a 
strong  advocate  of  the  knowledge  development  process,  was  "to  encumber 
the  design  with  a  huge  number  of  second-and  third-order  questions  that 
were  often  brilliant  and  insightful  but  totally  confusing  to  anybody 
but  Bob. " 

The  second  reason  why  Taggart  resisted  Hausman’s  advice  was  that 
the  early  results  of  knowledge  development  were  heavily  weighted  toward 
descriptions  of  the  process  by  which  projects  were  developed  and 
implemented  in  various  sites.  This  characteristic  caused  considerable 
friction  between  Taggart  and,  among  others,  the  Office  of  Management 
and  Budget.  The  OMB  examiner  for  YEDPA,  reflecting  a  characteristic 
institutional  bias  of  OMB,  said,  "I  expressed  very  strong  reservations 
from  the  beginning  about  how  it  was  developing,  particularly  about  the 
large  amount  of  money  being  spent  on  studies  that  didn’t  produce 
outcome  data.  OMB  likes  to  see  good,  strong  impact  evaluations. 

Taggart  didn't  see  it  that  way.  He  had  his  political  constituency  to 
protect.  So  most  of  the  stuff  he  produced  was  very  uninteresting  to 
us." 

The  reasons  for  the  emphasis  on  process  data  were  fourfold.  First, 
OYP  was  under  pressure  to  produce  results,  but  lacked  the  time  to  mount 
programs,  let  them  mature,  and  then  measure  their  effects.  The  next 
best  thing,  from  OYP’s  perspective,  was  to  build  into  the  knowledge 
development  process  extensive  information  about  the  process  by  which 
programs  were  implemented.  Or  in  Taggart's  words,  "In  the  first  year 
and  a  half,  our  problem  was  how  to  do  research  when  what  was  actually 
going  on  was  start-up  and  implementation." 

Second,  the  relatively  heavy  emphasis  on  process  information  in  the 
early  stages  was  consistent  with  Taggart’s  view  of  research  and 
evaluation  as  an  instrument  of  management  control,  process  information 
may  not  have  been  useful  to  OMB  in  making  government-wide  allocation 
decisions,  but  it  was  valuable  intelligence  to  Taggart  in  his  attempt 
to  create  and  manage  a  youth  employment  delivery  system.  Moreover,  by 
asking  for  process  information,  Taggart  was  communicating  that  he 
placed  a  high  priority  on  creating  an  infrastructure  to  mount, 
administer,  and  evaluate  youth  programs. 

Third,  the  wide  variability  in  design,  method,  and  type  of  results 
from  one  knowledge  development  project  to  another  meant  that  there  was 
no  straightforward  way  to  bring  specific  results  to  bear  on  cross¬ 
cutting  questions.  Separate  projects  were  contracted  through  a  variety 
of  organizational  arrangements,  discussed  below,  and  decisions  about 
the  research  and  evaluation  design  for  each  project  were  worked  out, 
case  by  case,  by  Taggart  and  the  OYP  staff.  While  there  was  an  overall 
"design,"  in  the  sense  that  individual  projects  were  related  to  a 
broader  set  of  policy  questions,  there  was  no  mechanism  for  assuring 
that  the  design  decisions  of  one  project  were  consistent  with  those  of 
other  projects  or  with  some  overall  set  of  methodological  criteria.  In 
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some  instances — YIEPP,  for  example — design  decisions  were  argued 
through  with  the  responsible  organization  in  a  detailed  way  and  with  a 
explicit  analysis  of  their  methodological  consequences. 

In  other  instances — typically,  joint  projects  with  other  federal 
agencies — design  decisions  were  allowed  to  evolve  according  to  the 
preferences  of  the  responsible  organizations,  or  were  not  addressed 
explicitly  at  all.  In  still  other  instances — the  creation  of  large- 
scale  data  bases  or  the  adaptation  of  existing  data  bases  to  youth 
questions,  for  example — there  was  a  high  level  of  delegation  to  the 
responsible  organization,  with  review  and  comment  by  OYP.  Variability 
then,  was  partly  a  function  of  the  complexity  of  the  issues,  programs, 
projects,  and  products  that  the  knowledge  development  plans  focused  on 
and  the  organizations  that  were  used  to  translate  those  plans  into 
action. 

But  variability  was  also  a  function  of  Taggart's  own  lack  of 
enthusiasm  for  consistency  and  rigor  in  methodology.  He  did  not 
believe  that  focusing  on  methodological  rigor  and  consistency,  at  the 
expense  of  other  objectives,  would  pay  off,  either  in  new  knowledge  or 
in  better  programs.  "People  complain,  after  the  fact,  on  a  study-by¬ 
study  basis,  about  things  like  the  lack  of  adequate  comparison  groups, 

Taggart  argues.  "S - .'  At  least  we  had  comparison  groups  in  a  lot  of 

studies.  That  was  more  than  anyone  else  had  done  on  that  scale 
before.  We  introduced  as  much  methodological  rigor  as  we  could,  even 
though  I  believed,  and  still  do,  that  it  wouldn't  work.  What  you're 
doing,  when  you  apply  fancy  research  methods  to  projects  like  the  ones 
we  had  early  in  the  program,  is  researching  ineffectuality,  not 
intervention.  The  fact  of  the  matter  is  that  people  don't  know  what  t< 
do.  All  you're  discovering  is  that  they  don't." 

For  Taggart,  the  primary  questions  were  developmental,  not 
methodological.  "None  of  this  research  will  yield  anything  if  people 
don't  know  what  they're  doing.  What  you  need  to  do  is  to  give  each 
part  of  the  delivery  system  a  piece  of  the  action,  use  monitoring  and 
evaluation  to  generate  competence,  pick  up  the  threads  running  through 
the  system  to  get  a  broad  understanding  of  what  makes  effective 
programs,  and  then  get  states  and  locals  to  make  decisions  about  who 
gets  what  and  get  them  to  monitor  and  enforce."  Questions  of  capacity 
organization,  and  management  were  prior  to  questions  of  design;  resear' 
methods  were  instrumental  to  the  development  of  a  delivery  system. 

Finally,  the  overall  design  of  the  knowledge  development  effort  an' 
the  design  of  specific  studies  changed  markedly  over  time.  For  example 
the  YIEPP  demonstration  started  by  testing  the  effect  of  a  fully 
subsidized  work  guarantee  on  school  attendance,  school  completion,  and 
short-term  employment.  About  halfway  into  the  demonstration,  the 
design  was  changed  to  accommodate  variable  subsidies,  on  the  expectati< 
that  Congress  would  want  to  know  whether  a  less  expensive  program  wouL 
have  positive  effects.  Also,  it  became  clear  after  YIEPP  commenced 
that  assuring  school  attendance  through  employment  guarantees  was  not 
necessarily  a  clear  benefit  to  young  people  if  the  the  school  program 
was  not  adapted  to  their  needs. 

Well  into  the  demonstration,  then,  attention  shifted  to  providing 
better  educational  programming  for  YIEPP  participants.  Another  example 


of  a  significant  design  shift  was  the  introduction  in  1979  of  the 
Consolidated  Youth  Employment  Program  (CYEP)  demonstration  in  nine 
prime  sponsor  areas.  The  purpose  of  CYEP  was  to  test  the  consolidation 
of  YETP,  YCCIP,  and  SYEP  grants  into  a  single  grant  directed  at 
multiple  purposes.  The  project  was  based  on  congressional  and 
executive  expectations  that  the  separate  youth  programs  authorized 
under  YEDPA  would  be  consolidated  in  the  1980  reauthorization  (DOL, 
1980c: 162-163) . 

The  YIEPP  example  indicates  how  shifts  in  design  can  be  stimulated 
by  external  expectations  and  by  discoveries  of  weaknesses  in  program 
design.  The  CYEP  example  shows  how  design  is  a  function  of  the 
political  agenda.  In  both  instances,  though,  changes  in  design  raise 
the  issue  of  whether  it  is  better  to  stick  to  a  single,  well-specified 
set  of  projects  for  as  long  as  it  takes  to  get  results,  or  whether 
designs  should  be  adjusted  to  external  changes  and  internal  discoveries. 
A  strictly  methodological  view  would  argue  for  holding  projects  constant 
until  results  are  clear,  since  "finding  out  what  works"  depends  on 
delivering  a  uniform  treatment  and  controlling  for  alternative  explana¬ 
tions  of  program  effects.  A  developmental  view,  however,  argues  for 
making  adaptations  whenever  they  are  required  to  improve  program  design 
and  adapt  to  changing  expectations.  The  knowledge  development  plans 
clearly  embodied  the  developmental  view. 

Design,  then,  meant  two  distinctly  different  things  in  the 
knowledge  development  plans.  First,  it  meant  accommodating  congres¬ 
sional,  executive,  and  institutional  interests  involved  in  the  youth 
employment  problem  in  some  sort  of  overall  scheme  and  using  that  scheme 
to  develop  an  institutional  base  for  youth  programs.  Second,  it  meant, 
in  the  more  conventional  methodological  sense,  designing  specific 
projects  to  deliver  specific  results  on  specific  issues.  Methodological 
questions  were  clearly  instrumental  to  institutional  development.  There 
is  a  third  meaning  of  design,  which  was  not  explicitly  represented  in 
the  knowledge  development  plans.  That  is  the  integration  of  specific 
findings  into  some  overall  set  of  cross-cutting  questions.  The  lack  of 
this  kind  of  design  was  the  result  of  Taggart's  strongly  centralized 
view  of  this  role  and  of  the  complexity  of  the  issues  incorporated  into 
YEDPA. 


ORGANIZATION  AND  MANAGEMENT 

The  magnitude  of  the  organization  and  management  problems 
confronting  Taggart  and  his  OYP  staff  in  the  fall  of  1977  have  already 
been  sketched:  Launch  three  new  national  programs  (YCCIP,  YETP,  YACC)  , 
launch  one  national  demonstration  program  (YIEPP) ,  expand  and  enrich 
two  existing  youth  programs  (Job  Corps  and  SYEP)  ,  and  allocate  over 
$200  million  in  discretionary  research  and  development  funds.  At  a 
minimum,  launching  new  programs  would  entail  writing  the  basic  rules 
that  would  govern  state  and  local  administration,  or  in  the  case  of 
YACC,  negotiating  the  necessary  interagency  agreements  that  would 
result  in  other  agencies  writing  the  basic  rules.  Taggart  estimates 
that  he  wrote,  or  supervised  the  writing  of,  about  40,000  pages  of 
program  guidelines  in  the  first  year. 


Launching  a  nationwide  demonstration,  like  YIEPP,  is  an  exercise 
politics,  administration,  and  research;  The  political  element  comes 
from  the  fact  that,  unlike  the  formula  grant  programs,  only  a  limited 
number  of  localities — 17  eventually  in  the  case  of  YIEPP — can  par¬ 
ticipate.  Which  localities  apply  and  which  are  eventually  selected  a 
matters  of  considerable  political  sensitivity.  Administratively,  the 
problem  is  how  to  get  state  and  local  organizations,  mainly  in  the 
business  of  delivering  employment  and  training  services,  to  agree  to 
participate  in  fixed-term  research  and  development  efforts.  The 
research  problem  is  devising  and  implementing  a  design  that  will  answ 
policy  questions  within  the  operating  constraints  imposed  by  the 
existing  delivery  system.  Allocating  discretionary  money,  as  we  have 
seen,  would  entail  defining  questions  responsive  to  congressional  and 
executive  interests,  elaborating  those  questions  into  plans  for  discr 
projects,  and  turning  those  plans  into  operating  programs  and  designs 

Another  way  of  illustrating  the  magnitude  of  the  organization  and 
management  problems  posed  by  YEDPA  is  to  focus  on  the  organization  an 
management  problems  involved  in  the  allocation  of  discretionary  funds 
If  the  average  discretionary  project,  defined  as  one  attempt  to  mount 
operate,  and  evaluate  an  idea  in  one  site,  were  to  cost  $500,000  over 
the  course  of  two-and-a-half  years,  there  would  be  roughly  1,000 
projects.  If  one  were  to  assume  that  OYP  would  have  20  full-time  sta 
available  to  focus  exclusively  on  discretionary  activities — an  extrem 
generous  assumption,  given  the  office's  other  responsibilities — each 
staff  member  would  have  responsibility  for  roughly  50  projects.  More 
over,  this  example  takes  account  only  of  the  oversight  necessary  to 
mount,  operate,  and  evaluate  projects.  It  does  not  include  the  effor 
necessary  to  mount  broad-scale  data  collection  across  projects,  to 
oversee  the  reporting  of  data,  and  to  synthesize  the  results  of 
disparate  projects  into  general  conclusions. 

The  administrative  feasibility  of  the  knowledge  development  effor 
was  dubious,  then,  under  even  the  most  generous  interpretation  of  OYP 
staff  capacity.  But,  according  to  a  number  of  observers,  including 
Taggart,  the  quality  of  OYP  staff  fell  short  of  the  best.  With  the 
exception  of  a  limited  number  of  staff,  perhaps  three  or  four,  whom 
Taggart  had  recruited  from  the  outside  or  from  positions  elsewhere  in 
DOL,  OYP  staff  were  neither  trained  for  nor  particularly  interested  i 
research  and  evaluation.  "They  were  basically  program  people,"  said 
one  individual  who  worked  closely  with  OYP  staff,  "and  not  the  best 
program  people  at  that."  Sensitivity  to  research  design  questions,  t 
ability  to  work  with  contractors  on  complex  research  issues,  and  an 
awareness  of  the  broader  consequences  of  specific  research  decisions 
were  attributes  that,  according  to  most  observers,  were  in  short  sup£ 
among  OYP  staff. 

One  of  the  central  puzzles  of  the  knowledge  development  effort  ws 
why,  given  the  enormous  federal  investment  and  the  risks  involved  in 
poor  execution,  OYP  did  not  hire  more  highly  qualified  staff.  At  lea 
two  explanations  have  been  advanced.  One  explanation  is  that  federal 
personnel  requirements  do  not  allow  agencies  to  respond  flexibly  to 
large  new  projects  with  high  short-term  requirements  for  people  with 
specific  skills.  The  personnel  system  is  designed  to  supply  and 


maintain  a  stable  career  work  force,  not  to  meet  peak-load  demands  of 
large-scale  research  and  development  projects.  Hence,  OYP  was  initially 
staffed  by  career  employees  transferred  from  other  DOL  programs,  and 
Taggart's  requests  for  additional  staff  were  met  with  the  reply  that 
OYP's  needs  had  been  met. 

Another  explanation  is  that  the  DOL  budget  office  and  OMB 
deliberately  used  staffing  as  a  way  of  showing  their  disapproval  of 
Taggart's  abrasive,  autonomous,  highly  political  style  of  management 
and  the  lack  of  methodological  clarity  in  the  knowledge  development 
design.  One  executive  branch  budget  analyst  said,  “That's  how  a  number 
of  actors  within  DOL  and  OMB  got  at  Taggart.  None  of  us  could  effec¬ 
tively  control  his  financial  resources,  but  we  could  [control]  his 
employment  resources.  Both  the  department  and  OMB  gave  his  requests 
each  year  for  more  staff  very  short  shrift — even  though  it  was 
manifestly  clear  he  was  way  understaffed."  Furthermore,  the  analyst 
argued,  "Taggart  never  submitted  a  clear,  workload-based  research 
design  that  we  could  use  to  evaluate  his  requests." 

OMB's  formal  position  on  Taggart's  requests  was  that  knowledge 
development  should  be  staffed  by  OPER,  and  that  OYP  staff  should  focus 
on  program  operations.  Behind  this  formal  position,  though,  was  a 
strong  distaste  for  Taggart's  unabashed  empire  building,  which  was 
shared  by  DOL  budget  staff.  A  budget  analyst  observed,  "Note  that  when 
[Tim]  Barnicle  [Taggart's  successor  as  head  of  OYP]  took  over  he 
immediately  got  an  OYP  [personnel]  increase — that's  because  he  knew  how 
to  play  ball.  .  .  .  There  are  many  weapons  in  bureaucratic  warfare." 
Whatever  the  explanation,  OYP's  staff  was  a  serious,  some  would  say 
fatal,  constraint  on  its  ability  to  mount  the  knowledge  development 
effort. 

These  constraints,  coupled  with  the  congressional  charge  to  forge 
federal  interagency  connections  and  to  rely  on  community-based 
organizations,  quickly  led  Taggart  to  "management  by  remote  control"  or 
"indirect  management"  of  the  knowledge  development  effort  (see  Salamon , 
1981).  In  Taggart's  words,  "It  takes  as  much  time  to  process  a  $5 
million  contract  as  it  does  a  $100,000  contract."  Given  a  choice 
between  managing  thousands  of  contracts  in  the  hundreds  of  thousands  of 
dollars  or  dozens  of  multi-million  dollar  contracts,  there  was  no 
contest  in  Taggart’s  mind.  The  basic  plan  was  to  get  the  money  out  of 
OYP  as  quickly  as  possible  in  a  series  of  large  chunks;  to  use  existing 
organizations,  or  to  create  new  ones,  outside  OYP/DOL  to  manage  discrete 
pieces  of  the  knowledge  develop  effort;  and  to  create  capacity,  also 
outside  OYP,  to  monitor,  assist,  and  manage  relationships  among  the 
pieces . 

In  its  basic  form,  this  organizational  scheme  was  not  unlike  the 
modern  corporate  conglomerate.  It  was  a  collection  of  free-standing 
enterprises,  each  with  one  or  more  "product  lines,"  each  with  its  own 
set  of  projects,  clients,  and  outputs,  held  together  by  contractual 
relations  with  the  center.  The  function  of  the  center  was  not  to 
manage  projects,  clients,  and  outputs,  but  to  see  that  the  constituent 
enterprises  were  following  through  on  their  contractual  obligation  to 
manage  those  things  themselves. 
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As  with  all  forms  of  organization,  this  one  has  its  characteristic 
strengths  and  weaknesses.  Its  main  strength  is  that  it  reduced  the 
span  of  control  at  the  center  by  roughly  a  factor  of  10 — from  poten¬ 
tially  thousands  of  separate  projects  to,  as  it  turned  out,  something 
over  100.  The  main  weaknesses  of  this  organizational  scheme  are  that, 
first,  its  success  depends  almost  totally  on  strong  management  capacii 
in  its  constituent  enterprises,  and  second,  that  the  structure  itself 
contains  no  obvious  solution  to  management  failures  in  constituent 
enterprises. 

When  problems  develop  in  the  pieces  of  a  corporate  conglomerate, 
central  management  either  replaces  the  management  of  those  enterprises 
or  sells  them  outright.  These  solutions  are  less  feasible  in  the 
public  sector.  More  importantly,  though,  the  constituent  pieces  of  a 
conglomerate — public  or  private — are  relatively  immune  to  central 
control  of  their  internal  operations,  even  when  they  are  poorly 
managed.  The  slightest  increase  in  management  control  from  the  centei 
can  create  an  enormous  overload  of  central  management.  For  this 
reason,  among  others,  corporate  management  has  tended  more  recently  tc 
move  away  from  conglomerates  and  toward  organizational  schemes  that 
permit  "tight"  central  management  of  finance  and  output  targets, 
coupled  with  "loose"  central  management  of  internal  organization  and 
operations  (Peters  and  Waterman,  1982) . 

Taggart's  strategy  of  indirect  management  depended  on  pulling  at 
least  five  distinctly  different  types  of  organizational  arrangements 
into  a  single  conglomerate  structure.  Table  7,  drawn  from  OYP's 
knowledge  development  projects  for  fiscal  1978  and  1979,  illustrates 
these  organizational  arrangements. 


Organizational  Arrangements 


Intermediaries 

The  use  of  intermediaries  was  an  outgrowth  of  DOL's  prior 
experience  with  the  Manpower  Demonstration  Research  Corporation 
(MDRC) .  The  brainchild  of  a  federal  interagency  task  force,  aided  by 
Ford  Foundation  support,  MDRC  had  designed,  implemented,  and  evaluated 
a  national  demonstration  of  supported  work  as  a  solution  to  welfare 
dependency  (Lowry,  1979).  Because  of  the  extremely  short  time  lines 
involved  in  launching  YIEPP,  MDRC  emerged  as  the  most  likely  candidate 
to  manage  that  demonstration.  If  the  MDRC  model  could  work  with  the 
entitlement  project,  why  not  try  it  with  others,  Taggart  reasoned. 
Hence,  in  November  1977,  the  Corporation  for  Public/Private  Ventures 
(CPPV)  was  established  to  handle  demonstrations  of  private  sector  yout 
employment;  in  January  1978,  Youthwork  was  established  to  handle 
exemplary  in-school  employment  programs;  and  in  May  1978,  the  Corpora¬ 
tion  for  Youth  Enterprises  (CYE)  was  established,  through  an  inter¬ 
agency  agreement  with  the  Community  Services  Administration  (CSA) ,  to 
manage  demonstrations  of  youth-run  enterprises. 

The  role  of  intermediaries  in  knowledge  development  has  to  be 
understood  in  connection  with  Taggart's  instrumental  view  of  research 


TABLE  7  Selected  Knowledge  Development  Activities 
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and  his  developmental  view  of  how  to  approach  the  youth  employment 
problem.  The  task  was  not  just  to  demonstrate  that  certain 
programs  operating  in  certain  settings  could  work,  but  more 
importantly,  to  create  a  large-scale  constituency  of  organizations 
committed  to  making  certain  programs  work  in  certain  settings. 

Later,  Taggart  (1980:15)  would  describe  his  purposes  as  follows: 

The  aim  of  the  involvement  strategy  was  to  build  up  the 
expertise  for  the  involved  groups  and  institutions  to  provide 
assistance  in  the  replication  of  specific  proven  models  under 
an  incentive  grant  structure,  as  well  as  intensive  technical 
assistance  on  specific  substantive  components  of  youth 
programming.  .  .  . 

Without  this  institutional  infrastructure,  there  would  be  no 
capacity  to  deliver  whatever  “solutions”  emerged  from  the  knowledge 
development  process.  The  investments  in  intermediaries,  then,  were 
partly  investments  in  research  and  development  and  partly  investments 
in  institutional  capacity.  Andrew  Hahn,  from  Brandeis,  puts  the 
problem  this  way:  "When  you  go  to  do  research  and  demonstration  in  th 
educational  system,  you've  got  a  lot  of  established  organizations  who 
can  create  curriculum,  train,  test,  and  evaluate.  Before  YEDPA,  there 
was  no  capacity  like  that  in  the  youth  employment  area,  just  a 
collection  of  small  entrepreneurs  and  a  big  employment  and  training 
delivery  system  focused  mainly  on  adult  programs." 

Intermediaries  were  a  short-term  capital  investment  in  a  longer- 
term  problem  of  institutional  capacity.  They  were  also  a  high-risk 
investment.  With  the  exception  of  MDRC,  none  of  the  intermediaries 
existed  prior  to  YEDPA,  nor  were  they  managed  or  staffed  by  people  who 
had  experience  in  similar  settings.  Consequently,  as  one  might  expect 
CPPV,  Youthwork,  and  CYE  made  their  early  decisions  on  an  opportunist! 
tr ial-and-error  basis  that  produced  a  predictable  mix  of  successes  and 
errors  (Lowry,  1979). 

Youthwork,  for  example,  recruited  its  staff  disproportionately  froi 
the  education  community,  giving  it  little  credibility  with  CETA  prime 
sponsors.  When  this  became  clear,  the  organization  adjusted,  but  lost 
precious  time  in  the  process.  All  the  intermediary  organizations,  wit] 
the  exception  of  MDRC,  had  difficulty  attracting  and  holding  qualified 
research  specialists,  and  this  fact  showed  up  in  the  quality  of  their 
initial  plans.  CPPV  managed  to  recruit  qualified  staff,  but  its  rela¬ 
tive  inexperience  in  management  created  start-up  problems.  Youthwork 
had  a  high  level  of  internal  turnover  in  its  first  two  years,  which 
undermined  its  ability  to  develop  research  expertise.  CYE  was  slow  in 
developing  and  never  managed  to  attract  and  hold  strong  research  staff 


Interagency  Agreements 

Interagency  agreements  were  an  outgrowth  of  congressional 
expectations  that  DOL  would  “pull  together  the  pieces"  of  the  federal 
government  around  the  youth  employment  problem.  The  portfolio  of 


interagency  projects  was  substantial  and  reflected  a  number  of 
agendas.  The  ACTION  projects  focused  on  youth  community  service, 
consistent  with  the  objectives  of  YCCIP.  The  CSA  projects  also  focused 
on  youth  community  service,  but  with  a  strong  emphasis  on  operations 
through  local  community  organizations  spawned  under  the  federal 
antipoverty  program  of  the  1960s.  The  HEW  projects  focused  on  con¬ 
nections  between  local  employment  and  training  programs  and  secondary 
or  postsecondary  institutions — a  key  congressional  concern.  The 
Department  of  Energy  project  focused  on  drawing  disadvantaged  youths 
into  new  careers  in  the  energy  field. 

The  interagency  projects  returned  little  in  the  way  of  structured 
research  and  evaluation,  for  reasons  that  are  relatively  clear.  While 
OYP  often  referred  to  its  federal  collaborators  as  playing  the  role  of 
prime  sponsors,  the  facts  were  that  OYP  could  exercise  virtually  no 
control  over  the  projects  they  administered  after  the  interagency 
agreements  were  signed.  The  agencies  were  neither  creatures  of  DOL — as 
prime  sponsors  were — nor  full-fledged  contractors — as  intermediaries 
were.  They  were  free-standing  federal  agencies  with  independent 
authority.  Hence,  if  they  lacked  the  capacity  to  do  systematic 
research,  or  if  they  disagreed  with  the  demands  that  research  and 
evaluation  imposed  on  their  discretion,  there  was  little  OYP  could  do 
to  force  their  cooperation.  Moreover,  since  the  purpose  of  interagency 
agreements,  from  the  congressional  point  of  view,  was  to  cement  internal 
relations  within  the  federal  government,  it  was  not  necessarily  in  the 
interests  of  OYP  to  provoke  embarrassing  interagency  conflicts  that 
would  be  difficult  to  explain  to  Congress. 


Intraagency  Projects 

Intraagency  projects,  as  noted  above,  served  an  important  internal 
objective  by  stabilizing  OYP's  relationship  with  ASPER  and  OPER.  But 
two  equally  important  additional  purposes  of  these  projects  were, 
first,  to  develop  a  basic  research  constituency  for  youth  employment 
among  academics,  and  second,  to  assure  that  youth  employment  issues 
were  adequately  addressed  in  established  longitudinal  data  bases,  like 
the  National  Longitudinal  Survey  and  the  Continuous  Longitudinal 
Manpower  Survey. 

In  their  own  way,  the  intraagency  projects  were  among  the  most 
successful  in  the  knowledge  development  process.  They  involved 
relatively  low-cost,  finite,  well-defined  tasks;  they  could  build  on 
established  institutional  capacity  (e.g.,  the  National  Bureau  of 
Economic  Research,  the  National  Council  on  Employment  policy);  and  they 
had  relatively  self-explanatory  payoffs.  But  for  all  their  appeal  in 
specificity  and  feasibility,  these  projects  were  not  very  valuable  in 
political  terms.  Better  research  and  more  complete  data  about  youth 
employment  were  useful  in  dealing  with  Congress  only  if  it  could  also 
be  demonstrated  that  DOL  was  "doing  something"  about  the  problems  it 
was  documenting. 


External  Staff  Support 


External  staff  support  was  a  direct  outgrowth  of  limited  staff 
capacity  within  OYP.  The  key  organization  was  the  Brandeis  Center  for 
Employment  and  Income  Studies.  CEIS  had  an  intentionally  broad  and 
ambiguous  charge:  "(l)  To  provide  technical  research  design  guidance 
to  the  national  array  of  experimental  and  demonstration  projects 
implemented  under  YEDPA ,  and  (2)  to  develop  administration  processes 
for  the  retrieval,  dissemination  and  policy  utilization  of  research 
findings  and  other  knowledge  development  products  of  these  discretion¬ 
ary  projects"  (DOL,  1980b: 278).  These  responsibilities  overlapped 
those  of  a  number  of  other  organizations,  including  the  Educational 
Testing  Service’s  (ETS)  development  of  a  Standard  Assessment  System 
(SAS),  the  design  and  evaluation  functions  of  the  intermediaries,  and 
number  of  other  individual  projects  with  their  own  evaluations. 

But  if  CEIS's  role  was  ambiguous  in  a  formal  sense,  its  practical 
function  was  much  less  so.  CEIS  staff  were  the  only  source  of  "latera 
intelligence"  in  the  complex  array  of  organizations  spawned  by  OYP. 
All  the  other  organizations  were  producing  "vertical  intelligence,"  ir 
the  sense  that  they  were  assigned  projects  with  specialized  target 
groups  and  particular  programs.  As  noted  above,  this  meant  that  the 
design  of  the  knowledge  development  effort,  if  it  was  to  exist  at  all, 
depended  on  the  ability  to  make  cross-cutting  conclusions  from 
disparate  projects. 

In  its  evaluation  consulting  and  technical  assistance  role,  CEIS 
was  not  just  trying  to  improve  the  quality  of  project  evaluations  (a 
difficult  task  by  itself) ,  it  was  also  gathering  intelligence  about 
what  the  developing  delivery  system  looked  like  across  a  variety  of 
localities  and  projects.  CEIS  also  performed  the  function  of  convenir 
periodic  conferences  to  review  design  decisions,  interim  results,  and 
practical  lessons.  In  the  absence  of  these  activities,  there  was  no 
formal  mechanism  for  getting  people  involved  in  the  knowledge  develop¬ 
ment  process  to  talk  to  each  other  about  their  results.  While  the 
lateral  intelligence  function  is  hard  to  specify  in  formal  terms,  and 
while  one  could  argue  that  under  the  best  of  circumstances  it  would 
have  been  performed  inside  OYP,  it  was  a  practical  necessity,  given 
OYP's  staff  capacity  and  the  organizational  complexity  of  the  knowledc 
development  effort. 

Another  important  external  support  function  was  provided  by  the 
Educational  Testing  Service's  Standard  Assessment  System.  The  initial 
idea  behind  SAS  was  plausible.  ETS  would  develop  a  single  battery  of 
instruments,  composed  of  measures  of  client  background  characteristics 
educational  measures,  and  employment  measures,  which  would  be  adminis¬ 
tered  to  a  large  sample  of  YEDPA  demonstration  project  participants, 
before  and  after  their  participation,  and  would  generate  a  data  base 
that  could  be  used  to  analyze  effects  across  sites  and  programs.  This 
battery  of  instruments  would  then  be  administered  by  prime  sponsors  as 
part  of  the  routine  requirements  that  accompany  YEDPA-funded  demonstra 
tion  projects.  The  results  would  be  collected,  compiled,  and  analyzed 
by  ETS,  but  also  made  available  to  others  for  special  studies. 
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By  most  estimates,  the  SAS  was  less  than  a  complete  success.  One 
problem  had  to  do  with  conflicting  expectations  about  its  use.  "People 
got  very  confused  about  the  purpose  of  the  SAS,"  said  CEIS's  Andrew 
Hahn.  " ETS  was  never  intended  to  be  the  evaluator.  The  idea  was  to 
create  a  large  data  base  and  make  ETS  the  repository."  But  because  ETS 
was  cast  in  the  role  of  developing  the  SAS,  explaining  it  to  program 
administrators,  and  collecting  data,  it  became  identified  as  an 
evaluator,  whether  that  was  its  role  or  not. 

This  led  to  a  second  problem,  which  was  conflict  between  ETS  and 
program  operators  over  the  use  of  the  SAS.  "Program  people  hated  it," 
Hahn  recalls,  "and  it  was  very  difficult  to  get  their  cooperation  in 
administering  it."  A  third  problem  was  ETS's  lack  of  experience  with 
the  employment  and  training  system,  a  problem  it  shared  with  a  number 
of  other  educational  organizations  that  got  involved  in  YEDPA  projects. 
Schools  are  relatively  acclimated  to  periodic  testing,  even  though 
principals  and  teachers  resist  it.  They  are  also  accustomed  to  ETS  as 
a  prominent  institution  in  the  testing  field.  Most  delivery-level 
organizations  in  the  employment  and  training  system  had  had  little  or 
no  experience  with  testing  and  saw  no  particular  reason  to  cooperate. 
ETS's  experience  did  little  to  prepare  it  for  these  practical  problems. 

A  final  problem  was  disagreement  over  the  design  and  content  of  the 
survey.  In  retrospect,  a  number  of  people  saw  gaps  in  the  data  and  in 
ETS's  analysis  of  it,  but  those  gaps  were  not  clear  when  initial 
designs  were  presented  and  approved.  Taggart  explains,  "I  delegated 
the  design  of  the  SAS  internally  and  never  reviewed  the  actual  content 
of  the  instruments  before  they  went  out.  That  was  about  the  only  thing 
I  didn't  review  in  detail.  When  the  first  results  came  back,  I  went 
through  the  ceiling — they  were  not  what  we  needed  at  all — and  read  the 
riot  act  to  the  staff  and  ETS.  From  that  point  on,  we  had  a  constant 
battle  to  try  and  turn  it  around." 


Constituency  Support 

Constituency  support  projects  were  designed  to  make  good  on 
Congress's  expectation  that  client  groups,  community-based  organiza¬ 
tions,  and  intergovernmental  constituencies  would  be  involved  and 
consulted  in  the  implementation  of  YEDPA  programs.  The  mayors', 
counties',  and  governors'  associations  were  important  in  maintaining 
any  political  support  for  any  future  youth  employment  activities,  since 
they  were  the  host  governments  for  CETA  prime  sponsors.  In  addition, 
they  had  a  strong  incentive  to  resist  separation  of  youth  programs  for 
other  employment  and  training  activities,  because  they  constituted  a 
"recategorization"  of  CETA  and  a  retreat  on  the  initial  broad  grant  of 
discretion  that  accompanied  CETA.  Putting  these  organizations  to  work 
identifying  exemplary  youth  programs  in  their  jurisdictions,  even  if  it 
did  not  produce  much  in  the  way  of  research,  was  a  useful  way  of  giving 
them  some  ownership  in  YEDPA. 

Constituency  and  client  groups,  like  the  Urban  League  and  SER,  were 
key  to  development  of  a  youth  employment  system  in  two  respects.  They 
were  the  national  interest  groups  for  their  local  community  organiza- 
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tions  and  therefore  wielded  some  political  influence  in  Washington, 
addition,  though,  their  local  organizations  were  often  the  only 
legitimate  route  of  entry  into  the  minority  community.  Where  prime 
sponsors  and  local  school  systems  were  identified  with  the  dominant 
local  political  system,  community-based  organizations  were  an  importai 
alternative  way  of  reaching  communities  that  might  not  be  well  conned 
to  that  system.  None  of  the  constituency  support  projects  was 
distinguished  for  its  research  and  development  value,  but  their 
political  value  was  apparent. 

For  Taggart  (1980:10),  the  payoff  for  investing  in  constituency 
support  lay  more  in  the  creation  and  management  of  a  delivery  system 
than  in  the  research  it  generated: 

Rather  than  passively  reacting  to  the  pressure  of  interest 
groups,  an  active  and  conscious  involvement  strategy  was 
adopted  from  the  outset  which  sought  to  identify  the  complete 
range  of  institutions  that  could  and  should  be  involved,  their 
areas  of  possible  comparative  advantage  and  interest,  and  then 
to  utilize  these  institutions  in  structured  demonstration 
projects  where  their  effectiveness  could  be  tested.  The 
knowledge  development  plan  was,  in  a  sense,  a  protective 
system;  to  get  funding,  institutions  had  to  adapt  to  the  design 
and  structure  of  demonstration  approaches.  The  overlay  of 
research  requirements  and  outside  evaluation  agents  was  a 
disciplining  force,  serving  a  monitoring  and  management 
function  which  would  not  otherwise  have  been  possible  given 
limited  staffing  in  the  Office  of  Youth  Programs. 

The  range  of  projects  described  in  Table  7,  as  wide  as  it  is, 
constitutes  only  a  very  small  sample  of  the  total  universe  of  activit 
funded  under  YEDPA  discretionary  authority.  Hence,  it  does  not,  by 
itself,  give  a  complete  picture  of  either  the  variety  of  projects  or 
the  complexity  of  the  organization  and  management  problems  confronted 
by  Taggart  and  the  OYP  staff.  The  selection  of  27  projects  in  Table 
is  a  small  fraction  of  the  127  projects  listed  as  knowledge  developmei 
activities  for  fiscal  1978  and  1979.  Roughly  30  OYP  staff  are  listed 
as  project  monitors,  but  15  of  those  oversaw  100  projects,  which  oftei 
amounted  to  an  individual  responsibility  for  $20-$30  million.  Even  i 
the  staff  had  been  well  prepared  for  their  research  and  development 
roles,  their  ability  to  attend  to  detailed  project  decisions  would  ha 
been  severely  limited. 

It  is  also  important  to  note  that  while  discretionary  funds  were 
used  to  finance  knowledge  development  activities,  they  were  not 
exclusively,  or  even  primarily,  used  for  research  and  evaluation.  In 
fact,  by  DOL's  estimate,  88  percent  of  total  discretionary  funds  was 
spent  on  employment  and  training  services,  3.3  percent  on  basic 
research,  .6  percent  on  evaluation  of  regular  programs,  5.3  percent  o 
evaluation  of  demonstration  projects,  and  2.8  percent  on  technical 
assistance  to  program  operators.  About  30  percent  of  discretionary 
funds,  outside  YIEPP,  was  directed  through  other  agencies  of  the 
federal  government  to  interagency  projects.  Close  to  78  percent  of 
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discretionary  funds  was  allocated  to  prime  sponsors,  18  percent  directly 
to  community-based  organizations,  and  6  percent  to  an  assortment  of 
other  organizations,  including  schools  and  private  employers  {DOL, 

1980b;  also  DOL,  1981) . 

The  message  these  figures  drive  home  is  that,  regardless  of  how 
important  research  and  evaluation  were  to  the  mission  of  knowledge 
development,  service  delivery  was  the  main  activity  performed  with 
discretionary  money  and  the  organizations  performing  that  service 
delivery  were  not,  by  their  nature,  sympathetic  to  research  and 
evaluation. 

Organization  and  management  problems  were  not  limited  just  to  the 
organizational  alliances  spawned  by  discretionary  funding.  There  were 
at  least  two  other  spheres  that  demanded  active  and  continuous  atten¬ 
tion.  One  of  these  spheres  was  the  CETA  delivery  system,  represented 
by  prime  sponsors  and  their  local  contractors.  The  other  was  what 
might  be  called  the  “policy  system,”  composed  of  actors  outside  OYP  who 
were  consumers  of  knowledge  development  products,  some  of  whom  were 
involved  in  developing  the  administration's  youth  employment  proposal. 


The  CETA  Delivery  System 

The  CETA  delivery  system  was  both  the  operating  base  for  most  YEDPA 
activities  and  the  major  source  of  practical  implementation  problems 
faced  in  the  knowledge  development  process.  It  would  have  been  pos¬ 
sible,  at  least  in  theory,  to  run  demonstration  projects  outside  the 
CETA  system,  by  creating  “hot-house”  projects  designed,  run,  and 
evaluated  by  researchers.  This  approach  was  antithetical  to  both  the 
legislative  charge  that  accompanied  YEDPA  and  to  Taggart's  strategy  for 
using  knowledge  development  as  a  management  tool.  By  insisting  that 
the  knowledge  development  process  be  run  through  the  existing  delivery 
system.  Congress  and  OYP  achieved  a  degree  of  involvement  and  practical 
experience  that  would  otherwise  have  been  impossible,  but  they  also 
bought  all  the  political  and  administrative  problems  that  accompany 
that  system. 

Prime  sponsors  represented  units  of  local  government;  the  adminis¬ 
trators  of  local  prime  sponsors,  as  well  as  their  local  constituent 
organizations,  were  a  political  force  in  their  communities  and  in 
Congress.  When  knowledge  development  imposed  demands  on  local  prime 
sponsors  that  they  considered  to  be  unreasonable,  and  when  OYP  refused 
to  concede,  prime  sponsors  had  alternative  routes  of  political  access 
through  which  to  get  the  results  they  wanted.  Erik  Butler,  a  former 
administrator  of  youth  programs  in  Boston  and  later  executive  director 
of  the  Vice  President's  Task  Force  on  Youth  Employment  said,  “When  MDRC 
came  to  talk  to  us  about  the  Entitlement  project,  they  were  talking 
research,  while  we  were  talking  program.  The  issue  was  how  to  accom¬ 
modate  their  interests  and  ours."  Marion  Pines,  a  nationally  visible 
employment  and  training  administrator  from  Baltimore,  took  her  com¬ 
plaints  about  the  reporting  and  administrative  demands  of  the  entitle¬ 
ment  project  directly  to  Congress,  making  a  plea  for  more  local  control 
over  design  decisions.  This  tension  between  national  objectives  and 


local  political  and  administrative  realities  was  played  out  in  a  num 
of  settings  on  a  number  of  issues. 

Taggart  cites  OYP's  attempt  to  improve  the  Summer  Youth  Employme 
Program  (SYEP)  as  one  of  his  most  illuminating  confrontations  with  t 
CETA  delivery  system.  "Summer  Enrichment,"  as  it  came  to  be  known, 
an  important  component  of  Taggart's  strategy  for  using  knowledge 
development  to  influence  the  quality  of  youth  programs.  As  is  clear 
from  Tables  2  and  3,  SYEP  accounted  (and  still  does)  for  a  large 
proportion  of  both  outlays  and  participants  in  federal  youth  employm 
programs.  Since  the  mid-1960s,  it  had  come  to  be  regarded  cynically 
politicians  and  administrators  largely  as  an  income  support  program 
in  the  language  of  the  street,  "fire  insurance." 

Taggart's  approach  was  to  focus  on  developing  better  jobs  for  th 
summer  program  and  adding  an  educational  component.  "In  the  first 
round,  we  tried  to  rewrite  the  program  requirements  to  include  bette 
monitoring  of  jobs  and  an  education  component,  assuming  that  if  we 
asked  for  them  and  made  it  explicit  in  evaluation  requirements  we  wo 
get  it.  We  completely  misjudged  the  capacity  of  prime  sponsors.  Wh 
we  discovered  was  that  there  was  rot  at  the  bottom  of  the  pyramid, 
problem  was  bad  management;  they  wouldn't  have  known  how  to  do  it  ev 
if  they  had  wanted  to.  So  we  put  some  discretionary  money  behind  it 
got  some  intermediaries  involved  in  creating  and  implementing  progra 
and  focused  on  the  problem  of  poor  management  at  the  local  level.  0 
time,  we  began  to  see  results.  But  the  problem  was  that  we  wasted  a 
year  finding  out  that  the  delivery  system  couldn't  respond  to  the 
demands  we  were  putting  on  it." 

The  problem  of  local  management  capacity  also  surfaced  in  a  YIEF 
where  MDRC  was  required  to  make  heavy  demands  on  local  prime  sponsor 
to  implement  a  specialized  information  system  to  track  entitlement 
participants,  and  in  the  implementation  of  the  Standard  Assessment 
System,  where  prime  sponsors  and  other  administrators  of  discretions 
projects  often  balked  at  the  additional  effort  required  to  administe 
the  complex  battery  of  instruments.  Taggart's  approach  to  both  the 
political  entrepreneurship  and  management  capacity  problems  was  to  r 
heavily  on  external  support  staff  and  intermediaries  both  to  buffer 
from  political  pressure  and  to  deliver  much-needed  advice. 


The  Policy  System 

The  policy  system  posed  another  set  of  problems.  Taggart's 
strategy  of  creating  an  extensive  network  of  external  organizational 
alliances  also  meant  that  it  had  to  be  consulted,  reinforced,  and 
accommodated.  The  major  problem  with  asking  for  advice  from  your 
constituents,  of  course,  is  that  you  often  get  it.  And,  more  often 
than  not,  it  comes  in  the  form  of  contradictory  messages. 

The  most  prominent  example  of  consultation  was  the  conference  he 
in  October  1978,  convened  by  the  Brandeis  center,  at  Reston,  virgini 
The  conference  occurred  early  in  the  development  of  the  knowledge 
development  process,  a  year  after  the  passage  of  YEDPA.  its  nominal 
purpose  was  to  bring  the  research  and  development  organizations 
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involved  in  the  process  together  to  discuss  common  methodological 
problems  and  to  develop  a  familiarity  with  the  overall  objectives  of 
the  process.  As  one  might  expect,  the  conference  turned  out  to  be  a 
collection  of  distinct  presentations  on  specific  projects,  followed  by 
discussions  in  which  participants  argued  positions  based  as  much  on 
their  institutional  and  methodological  biases  as  on  their  interest  in 
knowledge  development. 

Arnold  Packer,  DOL  assistant  secretary  for  policy  evaluation  and 
research,  commenting  on  a  presentation  of  the  entitlement  research 
design,  argued,  "We  must  be  sure  when  we're  spending  the  public's  money 
that  we  have  a  scientifically  solid  approach  and  the  ability  to  accept 
or  reject  specific  hypotheses  which  are  recognized  as  the  ones  that  are 
implicit  in  what  policy  makers  are  doing  and  thinking  about  in  such 
programs."  Policy  relevance  and  methodological  rigor,  it  seems,  were 
equally  important.  But  so  was  timeliness.  "Will  the  results  be 
available  by  the  time  legislation  must  be  drafted  next  year?"  Packer 
asked.  "January  1980  is  the  scheduled  date  for  submitting  administra¬ 
tive  recommendations.  When  the  budget  goes  up  a  year  from  this  January, 
if  we  are  going  to  ask  for  any  money  to  continue  youth  programs,  the 
legislation  has  got  to  accompany  the  budget"  (DOL,  1980e:25) .  How 
MDRC,  local  entitlement  projects,  and  OYP  were  to  accommodate  to  this 
schedule  was  their  problem,  not  the  problem  of  the  administration's 
policy  planners. 

John  Palmer,  an  employment  specialist  from  the  Brookings 
Institution,  took  advantage  of  the  occasion  to  counsel  moderation  on 
methodological  questions.  Commenting  on  YETP  discretionary  projects, 
he  said,  "Some  of  the  discussion  seems  to  suggest  that  we're  going  to 
be  able  to  vary  components  or  individual  elements  of  these  program 
structures  and  see  what  difference  it  makes.  I'm  dubious  that  that's 
going  to  be  possible  in  most  cases.  I  just  don't  think  that  the 
methodology  or  the  resources  that  are  being  brought  to  bear  are  going 
to  permit  that  to  happen.  You're  just  not  going  to  get  effective 
answers  to  those  questions  in  the  strict  research  sense.  You're  going 
to  get  important  answers  out  of  the  more  qualitative  analyses  that  are 
being  done  and  from  the  hunches  that  have  been  made." 

Palmer  continued  by  counseling  attention  to  what  he  called  "first 
order  questions,"  such  as,  "Was  it  feasible  simply  to  mount  and  execute 
the  program  under  the  design  conditions  we  are  trying  to  accomplish? 

Who  is  being  served?  Are  we  reaching  the  target  population?  Is  it 
working,  in  some  sense,  at  that  level?"  (DOL,  1980e:56).  These  ques¬ 
tions  were  several  notches  below  those  considered  important  by  other 
participants. 

Donald  Nichols,  an  ASPER  staff  member,  took  strong  exception  to  the 
lack  of  methodological  rigor  he  observed  in  many  knowledge  development 
projects.  "I  want  to  emphasize  the  need  for  consistency  across  these 
various  programs,"  he  argued.  "We  want  to  strive  to  bring  about  some 
kind  of  consistency,  so  that  we  can  not  only  make  comparisons  within 
each  of  these  projects,  but  so  we'll  also  be  able  to  make  pretty  good 
comparisons  of  one  approach  against  another."  He  continued,  "A  feature 
common  to  most  of  the  demonstrations  being  discussed  ...  is  that  they 
are  not  experiments  with  random  assignment  [to]  groups  and  the  like. 


results  are  hedged  ahead  of  time.  Some  of  the  researchers  soun 
great  deal  more  like  advocates  rather  than  scientists.  It  may  ' 
that  advocates  run  better  programs  .  .  .  but  it's  probably  not 
model  for  getting  research  results  on  something  you  might  think 
could  replicate  on  a  large  scale"  (DOL,  1980e:58). 

Vernon  Briggs,  from  the  Cornell  Labor  and  Industrial  Relati 
faculty,  issued  a  rebuttal.  "I  feel  we're  missing  what  is  perh 
greatest  contribution  of  these  programs  in  the  discussion  over 
classical  research  design.  It  seems  to  me  that  the  major  overr 
focus  behind  all  this  is  changing  institutions  in  desired  direc 
He  continued,  "I  think,  when  you  consider  the  whole  range  of  em 
training  programs,  the  results  of  the  research  and  the  demonstr 
are  used  by  a  number  of  different  actors  and,  depending  on  wher 
actors  sit,  they  have  different  agendas.  I  would  go  as  far  as 
that  I  think  that  a  typical  legislator  would  probably  think  mor 
terms  of  whether  services  are  actually  delivered  than  in  terms 
subtle  assessment  of  impacts"  (DOL,  1980e: 60-61) . 

Othello  Poulard,  director  of  the  Center  for  Community  Chang 
in  Washington,  D.C.,  delivered  an  even  more  fundamental  critiqu 
rigorous  research.  "As  a  practitioner,  I  can  say  there  isn't  t 
mystery,  as  might  be  suggested,  with  further  discoveries  in  unc 
truth.  I  wish  that  were  the  problem.  It  would  be  easy  if  the 
accumulation  of  a  few  more  facts  would  provide  the  remedy.  But 
residual  of  so  many  basic  societal  patterns  and  attitudes,  poli 
stances  and  the  like,  seem  to  be  so  obviously  at  the  heart  of  t 
matter.  ...  I  wish  there  could  be  'advocate'  research.  I  do 
think  that  bastardizes  research  at  all.  It  tempers  it.  It  is 
risky,  too  hazardous  to  just  assume  that  it  is  appropriate  let 
judicious,  to  take  the  pure  researchers'  approach.  If  the  atti 
behind  the  process  is  one  that  is  devoid  of  passion  and  commitm 
that  is  not  a  virtue"  (DOL,  1980e:61-62) . 

One  of  the  more  impassioned  versions  of  this  argument  was  m 
Robert  Schrank  of  the  Ford  Foundation.  "Large  sums  of  money  ha 
allocated  for  massive  quantitative  evaluation  effort,"  he  argue 
no  one  is  asking  what  the  pitfalls  of  such  research  might  be,  o 
whether  it  is  even  appropriate  to  what  we  are  trying  to  study." 
continued,  "The  object  of  the  research  is  a  network  of  youth  pr 
not  the  production  of  research  results.  If  research  focuses  at 
on  measurable  results,  at  the  expense  of  producing  long-term  ef 
institutions,  he  argued,  "the  objective  social  science  research 
may  turn  out  to  be  more  of  a  burden  than  a  beacon  for  policymak 
He  went  on  to  note  "a  terrible  tension  between  doing  objective 
tion  and  trying  to  make  a  program  succeed"  that  worked  against 
term  solutions  and  in  favor  of  short-term  results.  He  also  obs 
that  one  effect  of  doing  evaluations  of  War  on  Poverty  programs 
were  not  effectively  institutionalized  was  to  reinforce  the  not 
that  "the  social  problems  we  were  attempting  to  solve  were  intr 
rather  than  the  right  solutions  hadn't  been  tried  (DOL,  1980e:3 

In  essence,  then,  when  Taggart  consulted  his  policy  researc 
constituency  for  advice  about  how  to  do  knowledge  development. 
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back  a  faithful  representation  of  the  prevailing  disagreements  within 
that  constituency  over  the  methods,  content,  uses,  and  practical 
consequences  of  policy  research,  which  were  outlined  at  the  beginning 
of  this  paper.  There  was  pressure  for  timely  results  that  would  inform 
policy,  but  little  understanding  of  what  policy  makers  actually  wanted 
to  know  and  less  appreciation  for  how  long  it  would  take  to  find  out. 
There  was  pressure  for  methodological  rigor,  but  no  agreement  on 
whether  there  were  treatments  that  were  compatible  with  the  experimental 
model  or  whether  experimentation  was  compatible  with  the  commitment 
necessary  to  make  programs  work.  There  was  advice  to  stick  to  the 
business  of  research  and  avoid  the  pitfalls  of  advocacy,  but  no  advice 
about  how  to  mount  programs  in  a  complex  political  and  administrative 
setting  without  advocacy.  There  was  counsel  to  respect  the  tension 
between  dispassionate  research  and  commitment  to  particular  programs, 
but  no  concrete  organizational  solutions  for  how  that  tension  could  be 
resolved.  There  was  advice  about  the  dangers  that  accompany  premature 
tests  of  program  effects,  but  no  clear  understanding  of  when  new 
programs  should  be  evaluated. 

No  doubt,  the  participants  in  the  Reston  conference  believed  they 
had  delivered  a  clear  message  to  Taggart  about  the  direction  knowledge 
development  should  take.  The  overall  effect,  though,  was  to  reproduce 
the  general  lack  of  agreement  and  to  strengthen  Taggart's  resolve  in 
pursuing  the  strategy  he  had  chosen.  For  all  its  defects,  Taggart's 
strategy  at  least  had  tentative  solutions  to  the  problems  of  large- 
scale  policy  research. 

A  far  more  serious  set  of  policy  system  problems  was  posed  by  the 
Vice  President's  Task  Force  on  Youth  Employment.  As  noted  above, 
sometime  in  the  fall  of  1978,  the  administration  seized  on  youth 
employment  as  its  major  social  policy  issue  for  the  1980  campaign, 
having  run  into  difficulty  with  welfare  reform.  The  Task  Force  was  as 
ambitious  a  policy  development  exercise  as  ever  takes  place  in  the 
federal  government.  It  involved  a  significant  central  staff,  led  first 
by  Tom  Glynn,  former  director  of  planning  and  budget  for  ACTION,  and 
later  by  Erik  Butler,  a  director  of  youth  programs  from  Boston  and  a 
researcher/practitioner  at  Brandeis. 

The  Task  Force  drew  on  the  policy  staff  of  the  Domestic  Council, 
including  Bill  Spring  and  Kitty  Higgins,  a  DOL  staff  member  on  detail 
to  the  White  House,  and  on  outside  consultants,  including  Peter 
Edelman,  former  director  of  youth  services  for  New  York  State.  It 
involved  extensive  interagency  consultations  between  the  Departments  of 
Education  and  Labor.  It  served  as  the  locus  for  wide  consultations 
around  the  country  with  business,  labor,  education,  and  employment 
leaders  and  practitioners.  And  it  resulted  in  the  presentation  of  a 
major  piece  of  legislation  to  the  Congress  in  January  1980.  The  Task 
Force's  budget,  amounting  to  $1,027,485  over  fiscal  1978  and  1979,  was 
financed  from  YEDPA  discretionary  funds  (DOL,  1980b) . 

Aside  from  the  fact  that  the  Task  Force  was  funded  from  his  budget, 
Taggart  and  OYP  had  larger  interest  in  its  work.  If  the  President's 
proposal  passed  Congress,  it  would  set  the  structure  of  youth  programs 
for  the  foreseeable  future.  Taggart  saw  the  longer-run  stakes  of  the 
Task  Force's  work  and  focused  a  large  amount  of  his  energy,  between 
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early  1979  and  January  1980,  on  drafting  the  DOL  side  of  the  pr< 
In  doing  so,  he  attempted  to  draw  whatever  lessons  were  availab 
the  first  year's  experience  with  YEDPA  and  from  the  conventiona 
emerging  from  sustained  attention  to  the  problem  of  youth  emplo 

From  Taggart's  review  he  deduced  a  few  relatively  straightf* 
principles  that  were  to  shape  both  the  administration's  youth 
initiative  and  subsequent  changes  in  federal  employment  and  tra 
policy.  In  part,  these  principles  were  as  follows  (DOL,  1980a i 

•  Standards .  Everyone  involved  in  the  employment  training 
enterprise  should  be  held  to  mutually  agreed,  self-imposed  stan 
or  benchmarks,  of  performance.  Trainees  who  do  not  meet  perfori 
expectations  should  be  moved  out  of  programs  to  make  room  for  t. 
are  willing  to  try.  Employers  should  be  willing  to  provide  stri 
and  demanding  activities  in  the  workplace.  Training  organizati* 
should  be  willing  to  set  performance  standards  for  themselves  ai 
clients. 

•  Sequenced  Activities.  Programs  should  begin  at  the  leve 
competence  of  entering  trainees  and  should  follow  a  sequence  of 
structured  steps  designed  to  move  trainees  into  unsubsidized  em] 

•  Targeted  Resources.  Funding  formulas  and  administrative 
decisions  should  reflect  the  difference  between  high-cost,  inte: 
services  for  high-risk  youths  and  low-cost,  less-intensive 
"transitional"  services  for  more  mainstream  youths.  The  highes 
priority  should  be  highly  targeted,  concentrated  programs  for  tl 
neediest. 

•  Consolidated  Programs.  The  array  of  categorical  youth 
programs  initiated  by  YEDPA  should  be  consolidated  into  a  singL 
program  structure. 

•  Employment-Education  Collaboration.  The  early  efforts  a 
better  coordination  between  prime  sponsors  and  local  educationa 
systems  did  not  produce  widespread  changes,  but  the  objective  i; 
important  one  for  federal  policy. 

•  Institutional  Comparative  Advantage.  Some  organizations 
notably  community-based  organizations,  have  a  comparative  advan 
reaching  high-risk  youths,  although  they  vary  widely  in  capacit; 
deliver  services.  Their  role  should  be  strengthened. 

•  Local  Accountability.  The  federal  program  structure  shoi 
encourage  attention  to  measurable,  quantitative  outcomes,  rathe 
to  implementing  complex  regulations  on  program  content. 

Other,  more  specific,  lessons  emerged  from  reviews  of  the  preli: 
YEDPA  evidence  performed  by  Erik  Butler  and  Jim  Darr  (Butler  an< 
1979)  .  These  lessons  focused  on  a  review  of  program-by-program 
results,  but  generally  followed  the  same  themes. 

In  short,  the  Task  Force  and  the  administration's  youth  ini 
forced  a  telescoping  of  the  larger  knowledge  development  proces; 
short  period.  Many  of  the  longer-term  institutional  developmen 
research  objectives,  while  they  continued  to  be  important  withii 
were  pushed  aside  in  the  policy-making  arena  in  the  interest  of 
developing  an  administration  proposal. 
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If  the  the  Carter  youth  initiative  had  passed  Congress,  and  if 
Carter  had  won  reelection  in  1980,  the  knowledge  development  process 
might  have  continued  to  pursue  the  longer-term  institutional  develop¬ 
ment,  and  the  research  objectives  it  contained  might  have  received 
attention.  But  these  things  didn't  happen.  The  Carter  youth 
initiative  passed  the  House  in  August  1980,  but  failed  to  reach  the 
floor  in  the  Senate.  Carter  lost  his  reelection  bid.  In  the  early 
months  of  the  Reagan  administration,  federal  employment  and  training 
policy  underwent  a  major  change,  including  the  elimination  of  most 
YEDPA  programs,  with  the  passage  of  the  Job  Training  Partnership  Act. 


The  Demise  of  Knowledge  Development 

Long  before  the  introduction  of  the  Carter  youth  initiative,  though, 
there  was  evidence  that  the  knowledge  development  process  was  beginning 
to  come  apart  in  certain  critical  ways.  First,  the  organizational 
network  created  at  the  beginning  of  the  program  began  to  require 
management  from  the  center  that  OYP  was  hard-pressed  to  provide.  In 
the  words  of  a  DOL  observer,  "It  was  one  thing  to  get  all  those 
contracts  negotiated,  written,  and  signed  in  the  first  place,  and  quite 
another  to  deal  with  the  problems  that  surfaced  when  the  organizations 
started  to  have  problems,  not  to  mention  turning  the  whole  system  over 
when  the  contracts  needed  to  be  renewed  or  terminated." 

Second,  the  politics  around  the  Vice  President's  Task  Force  began 
to  take  its  toll  on  Taggart,  politically  and  physically.  By  early 
1980,  it  had  become  clear  that  youth  employment  was  the  only  game  in 
town  for  those  interested  in  affecting  domestic  policy.  With  the 
election  approaching,  activity  around  the  administration's  proposal 
became  feverish.  There  were  predictable  tensions  between  the  Task 
Force  and  Taggart  over  details  of  the  administration's  proposal  and  the 
mechanics  of  assembling  it.  Taggart  worked  around  the  clock  for  months 
drafting  a  proposal  and  selling  it  within  the  administration.  At  one 
point  before  the  administration's  proposal  had  been  sent  to  Congress, 
one  participant  remembered,  "When  Taggart's  recommendations  weren't 
incorporated  fully  into  the  administration  bill,  he  circulated  his  own 
version  around  town  and  on  the  Hill.  This,  needless  to  say,  did  not 
endear  him  to  the  Task  Force  people."  In  the  end,  the  employment 
provisions  of  the  administration's  proposal  were  largely  determined  by 
Taggart.  But  the  costs  of  this  political  manuevering  were  reckoned  in 
the  loss  of  sustained  attention  to  the  management  of  the  knowledge 
development  process. 

The  unraveling  of  the  knowledge  development  process  began  in  March 
1980,  when  Taggart  resigned  his  position  as  OYP  administrator.  After 
leaving  OYP,  Taggart  worked  independently,  with  foundation  funding, 
assembling  research  results  on  employment  and  training  programs.  He 
then  established  the  Remediation  and  Training  Institute,  a  private 
nonprofit  organization,  again  with  foundation  funding  to  provide 
assistance  to  local  employment  and  training  operators.  Taggart  was 
replaced  by  Tim  Barnicle,  a  regional  DOL  administrator  from  Boston, 
from  March  1980  to  January  1981.  After  that,  OYP  was  run  in  the  early 
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months  of  1981  by  Richard  Gililand,  a  former  DOL  regional  adminis¬ 
trator,  who  was  transferred  to  the  job  by  the  then  Assistant  Secretar 
for  Employment  and  Training,  Albert  Angrisani.  After  the  passage  of 
the  JTPA,  OYP  was  disbanded.  Some  of  its  staff  were  reassigned  to 
various  other  parts  of  the  agency,  some  left  the  department  in  a  seri< 
of  reductions  in  force,  and  "knowledge  development"  ceased  to  exist. 

Though  the  activity  called  knowledge  development  ceased  to  exist, 
many  of  the  contracts  negotiated  as  part  of  the  knowledge  development 
strategy  were  still  outstanding.  Some  contracts  extended  into  1982. 
In  an  effort  to  bring  some  order  and  closure  to  these  contracts,  the 
Brandeis  Center,  in  late  1981,  compiled  a  list  of  unfinished  projects 
along  with  recommendations  for  their  disposition.  They  identified 
about  120  incomplete  discretionary  projects,  of  which  all  but  a  few 
required  additional  DOL  action  to  close  them  out.  They  also  examined 
data  collection  activities  under  ETS's  Standard  Assessment  System,  an 
found  20  of  48  sites  in  which  data  were  incomplete. 

The  posture  of  Reagan  appointees  in  the  Department  of  Labor  towar 
these  unfinished  projects,  by  most  accounts,  ranged  from  indifference 
to  outright  hostility.  "When  the  new  administration  arrived,"  one 
insider  recalled,  "an  immediate  freeze  was  put  on  all  time  extensions 
and  refundings  of  the  ongoing  research  efforts.  They  wouldn't  even  1 
the  entitlement  research  be  completed  until  an  editorial  appeared  in 
the  Washington  Post  that  created  a  Congressional  uproar.  It  is  in  th 
nature  of  research  that  repeated  time  extensions  and  some  cost  overru 
occur.  By  systematically  refusing  extensions  and  [by]  disbanding  the 
youth  office,  most  research  was  halted  in  its  tracks.  Without  a 
program  officer  to  follow  up  for  final  reports  and  without  time 
extensions,  even  where  new  funds  were  not  required,  and  without  any 
hope  of  new  research  money  coming  from  the  department  lots  of  these 
committed  academics  just  went  off  in  search  of  other  grants.  Others 
didn't  have  the  funds  to  analyze  the  data  they  had  collected.  .  .  . 

"No  one  ever  bothered  to  follow  up.  In  fact,  the  atmosphere  was 
very  hostile  to  research  and  other  discretionary  projects.  We  were 
instructed  to  call  grantees  and  tell  them  they  couldn't  publish  paper 
unless  the  department  cleared  them.  Such  an  instruction  contradicted 
the  actual  language  encouraging  publication  in  the  grants  themselves. 

A  career  DOL  employee  with  extensive  experience  in  evaluation 
observed  that  after  the  change  in  administrations  the  contracts  were 
"technically"  administered,  "but  no  longer  with  knowledgeable  staff  o 
any  sense  of  high-level  attention."  Andrew  Hahn,  from  Brandeis,  is 
more  pointed:  "Our  posture  was  that  the  taxpayers  had  already  paid  f 
the  research  and  they  should  have  the  benefit  of  the  results.  We  tri 
to  lay  out  what  was  necessary  to  close  it  [knowledge  development]  off 
with  the  best  results  possible.  It  became  clear,  though,  that  finish 
was  not  a  high  priority."  The  Reagan  administration's  interest  in 
dissociating  itself  from  the  program  of  an  earlier  administration  was 
understandable.  Its  means  of  dissociating  itself  so  was  less  under¬ 
standable  to  people  with  a  strong  interest  in  research  and  evaluation 

The  demise  of  knowledge  development,  then,  was  a  compound  of  mana 
ment  and  politics.  The  management  problems  stemmed  directly  from 
strategic  decisions  about  the  purposes  of  knowledge  development  and  t 
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organizational  form  necessary  to  carry  out  those  purposes.  Knowledge 
development  began  to  come  apart  organizationally  when  the  problems  of 
conglomerate  organization  became  clear  and  no  solutions  were  forthcoming 
from  Taggart  and  his  staff.  The  complex  system  of  intermediaries, 
external  staff,  intraagency  and  interagency  agreements  was  predicated 
on  the  accurate  assumption  that  OYP,  by  itself,  could  not  manage  an 
enterprise  of  the  scale  required. 

The  system  was  a  way  of  dispersing  responsibilities  among  a  variety 
of  organizations,  while  at  the  same  time  maintaining  a  central  agenda. 
Taggart  could,  in  the  early  stages,  by  sheer  force  of  personality  and 
intellectual  energy,  give  this  system  some  coherence  through  his  use  of 
research  as  a  management  tool.  The  chief  vulnerability  of  this  kind  of 
system,  though,  is  that  when  the  constituent  parts  begin  to  have 
problems,  the  center  is  ill  equipped  to  solve  them.  And  when  the 
center  becomes  overloaded,  as  it  did,  with  the  problems  of  the 
constituent  parts  and  with  external  pressures  of  the  policy  agenda,  the 
system  begins  to  shake  itself  apart  into  individual  projects.  The 
center  depends  on  the  constituent  pieces  to  make  the  system  work.  But 
OYP  was  not  able  to  generate  enough  capacity  in  its  constituent  pieces 
fast  enough,  or  uniformly  enough,  to  relieve  pressure  on  the  center. 

The  political  causes  of  the  demise  of  knowledge  development  lie, 
ironically,  in  the  close  connection  between  research  and  policy. 
Congress,  or  at  least  the  House,  expected  useful  answers  to  the 
question  "What  works  for  whom?"  in  time  for  the  CETA  reauthorization  in 
1978.  The  Carter  administration,  when  it  finally  turned  its  attention 
to  youth  employment,  expected  support  for  a  new  domestic  initiative. 
Taggart's  research,  program,  and  policy  constituencies  expected 
methodological  rigor,  sensitivity  to  administrative  constraints,  and 
firm  answers  to  policy  questions. 

How  the  contradictions  among  these  demands  were  to  be  reconciled 
was  a  problem  his  constituents  happily  left  to  Taggart.  From  the 
beginning,  knowledge  development  was  expected  to  inform  policy — early 
and  often.  It  was  not  to  be  a  long-distance  run  with  a  single  finish 
on  some  remote  horizon;  it  was  to  be  a  series  of  sprints  with  the 
finish  lines  dictated  by  political  landmarks.  Taggart  did  little  to 
discourage,  and  much  to  encourage,  this  view;  it  reflected  his  own 
belief  in  the  active  relationship  among  policy,  program  management,  and 
research.  The  consequences  of  this  close  connection  between  policy  and 
research,  however,  were  twofold.  First,  as  the  1980  election 
approached,  the  demands  of  managing  the  conglomerate  were  overwhelmed 
by  the  demands  of  policy  making.  It  wasn't  enough  for  Taggart  to  focus 
on  making  an  unwieldy  organization  work;  he  had  also  to  focus  on 
influencing  administration  policy.  Second,  when  the  political  agenda 
shifted,  with  the  election  of  Ronald  Reagan,  the  ground  was  cut  from 
under  the  program. 


INFLUENCE  ON  POLICY  AND  PRACTICE 


Despite  the  unfinished  work,  and  the  ignominious  end,  the  knowledge 
development  process  generated  a  large  volume  of  research  on  the  subject 
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of  youth  employment.  One  tangible  proof  of  this  output  is  the 
lished  collection  of  knowledge  development  reports,  begun  befoi 
Taggart  left  and  continued  through  1980,  which  contain  the  plar 
documents,  evaluations,  and  basic  research  reports  completed  b< 
1981.  The  complete  collection  comprises  more  than  70  reports, 
to  400  pages,  color  coded  by  topic,  in  the  form  they  were  recei 
final  products  from  research  contractors,  with  short  introducti 
explaining  how  their  content  relates  to  the  overall  set  of  ques 
around  which  the  knowledge  development  process  was  designed.  1 
behind  this  method  of  dissemination  was  to  make  as  much  of  the 
knowledge  development  research  quickly  available  to  policy  make 
policy  analysts,  researchers,  and  practitioners  as  possible  anc 
synthesize  it  later.  CEIS,  at  Brandeis,  was  to  play  the  role  c 
pulling  the  pieces  together  around  common  themes.  Because  of  t 
abrupt  way  the  process  was  terminated,  the  product  of  the  feder 
investment  became  those  undigested  reports,  and  the  Brandeis  s} 
continued  later  under  private  funding. 

OYP  began  mailing  the  reports  to  potential  consumers  in  mic 
In  some  quarters,  notably  Capitol  Hill,  this  approach  had  the  c 
of  its  intended  effect.  Some  people,  it  appears,  preferred  the 
research  in  smaller  bites.  Nat  Semple,  former  House  minority  s 
member,  said  facetiously,  "We  came  to  one  morning  and  they  back 
dumptruck  up  to  the  building  and  unloaded  a  ton  of  reports.  Th 
just  wasn't  useful." 

The  same  people  who  ridicule  the  way  the  knowledge  developn 
reports  were  disseminated,  however,  are  generally  complimentary 
background  materials  and  "lessons  from  experience"  papers  that 
panied  the  Carter  administration's  youth  initiative.  These  suit 
of  the  first  two  years  of  knowledge  development  were,  in  the  vi 
Hill  staff,  written  in  language  understandable  to  legislators, 
addressed  to  issues  considered  important  on  the  Hill,  and  genei 
responsive  to  questions  that  arose  in  consideration  of  the  yout 
initiative. 

Reinforcing  this  perception  from  the  Hill  is  the  perception 
those  who  worked  on  the  Carter  youth  initiative.  Domestic  Poli 
member  Bill  Spring  argues,  "I  think  there  is  broad  agreement  air 
those  of  us  who  worked  in  the  White  House  that  the  Youth  Initia 
probably  the  best-run  policy-making  exercise  in  the  Carter  year 
got  the  right  information  to  the  right  people,  it  forced  the  ed 
folks  to  talk  to  the  employment  and  training  folks,  it  forged  a 
consensus  on  how  to  get  at  an  important  problem.  You  have  to  s 
none  of  that  would  have  been  done  in  the  same  way  without  the  k 
development  process  to  back  it  up." 

Most  of  the  supporting  documents  for  the  youth  initiative  w 
be  considered  "research,"  in  the  strictest  sense  of  that  term, 
they  were  often  couched  in  the  language  of  "what  works."  They 
often  took  the  form  of  recommended  standards,  criteria,  funding 
mechanisms,  and  institutional  arrangements  emerging  from  practi 
experience.  Around  these  operational  issues,  a  consensus  began 
emerge  in  about  1980  that  spans  partisan  loyalties  and  ins ti tut 
affiliations.  This  consensus  has  had  a  significant  influence  o 
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federal  policy.  It  forms  the  basis  for  much  of  the  statutory  language 
and  administrative  structure  surrounding  the  Joint  Training  Partnership 
Act  ( JTPA) .  Robert  Gutman,  the  Senate  majority  staff  member  who  took 
the  leading  role  in  drafting  JTPA,  was  also  involved  in  the  drafting  of 
YEDPA  and  in  discussions  of  the  Carter  youth  initiative,  in  which  the 
same  issues  surfaced.  A  wide  range  of  people,  from  Taggart  to  the 
Brandeis  staff  to  the  Vice  President's  Task  Force  staff  to  congressional 
staff,  claim  credit  for  influencing  the  content  of  JTPA.  This  consensus 
is  an  important  indication  that  YEDPA  and  its  attendant  policy 
activities  created  an  occasion  for  rethinking  the  legislative  and 
administrative  structure  surrounding  federal  youth  employment  programs. 

This  consensus  has  been  described  in  a  number  of  ways  in  a  variety 
of  documents  (Taggart,  1981;  Hahn  and  Lerman,  1983;  National  Council  on 
Employment  Policy,  1983,  n.d.),  but  it  includes  at  least  the  following 
basic  elements: 

•  Focus  on  High-Risk  Youths.  Limited  federal  resources,  the 
indeterminacy  of  aggregate  unemployment  statistics  for  youths,  and  the 
seriousness  of  the  problems  faced  by  economically  disadvantaged  high 
school  dropouts  all  argue  for  a  strategy  more  highly  focused  on  what 
Taggart  calls  "the  leftovers" — young  people  excluded  from  conventional 
routes  to  education  and  employment. 

•  Deemphasize  Income  Maintenance,  Emphasize  Employment.  Employ¬ 
ment  programs  should  have  employment  objectives,  income  maintenance 
programs,  and  income  maintenance  objectives.  Training  stipends  and 
wage  subsidies  should  be  set  to  encourage  unsubsidized  employment  and 
reward  performance,  rather  than  to  provide  income. 

•  Deemphasize  Work  Experience,  Emphasize  Basic  Skills  and  Job 
Training.  Work  experience  should  no  longer  be  used  as  the  catch-all 
solution  for  the  unemployed.  It  seldom  leads  to  longer-term  employment 
unless  it  is  linked  in  some  systematic  way  to  education  and  training. 

•  Use  Individualized  and  Sequenced  Programs.  Many  of  the 
failures  of  employment  and  training  programs  stem  from  mismatches 
between  the  competencies  of  the  trainees  and  the  content  of  the 
programs.  Programs  should  be  designed  to  provide  basic  education, 
training,  and  job  entry  in  a  sequence  and  combination  that  matches  the 
individual's  requirements,  with  intermediate  benchmarks  to  gauge 
performance  along  the  way. 

•  Require  Performance  Standards  for  both  Individuals  and 
Programs.  Employment  is  the  expected  outcome  of  employment  programs, 
therefore  people  in  the  employment  and  training  system  should  be 
evaluated  and  rewarded  on  the  basis  of  their  performance  in  securing 
long-term,  unsubsidized  employment.  Intermediate  benchmarks  are 
important,  but  employment  outcomes  are  essential. 

•  Reward  Performers.  The  absence  of  positive  rewards  for  both 
individuals  and  program  operators  leads  to  a  focus  on  the  lowest  common 
denominator  of  participants.  Programs  should  select  from  the  most 
disadavantaged  and  reward  those  who  succeed  in  meeting  expectations. 

•  Use  Mainstream  Institutions.  The  isolation  of  education  and 
training  for  the  disadvantaged  from  mainstream  institutions,  especially 
employers,  compounds  problems  of  access.  Heavier  reliance  on 
apprenticeships  and  employer-based  training  decreases  barriers  to  entry. 


•  Invest  in  Capacity.  The  employment  and  training  system  has 
been  among  the  most  unstable  of  domestic  service  systems.  It  needs  a 
stable  base  of  federal  support  and  a  professional  constituency  to  do 
its  job. 

•  Incremental  Expansion.  The  employment  and  training  system  has 
been  buffeted  by  a  series  of  dramatic  shifts  in  policy  since  it  was 
established.  New  policies  should  be  allowed  to  mature  and  develop 
before  they  are  dramatically  altered. 

None  of  these  principles  seems  particularly  revolutionary,  nor 
particularly  "scientific"  or  counter-intuitive  for  that  matter.  But 
measured  by  the  distance  between  the  conventional  wisdom  of  1976  and 
that  of  1985,  rather  than  the  tenets  of  social  science  method,  they 
constitute  a  profound  shift.  This  shift  is  attributable  largely  to  t 
fact  that  YEDPA  focused  the  attention  of  researchers,  practitioners, 
and  policy  makers  for  a  time  on  connecting  practice  with  policy. 

Another  indication  of  the  influence  of  knowledge  development  is  t 
general  perception  among  policy  staff  and  their  bosses  that  the  YIEPE 
demonstration,  the  largest  and  most  visible  of  the  knowledge  developir 
activities,  was  successful.  Most  staff  cite  the  findings  of  the  MDRC 
reports  on  entitlement  as  evidence  that  well-designed  and  well-manage 
programs  can  have  an  impact  on  high-risk  youths,  that  despite  start-u 
difficulties  in  some  settings  it  is  possible  to  mount  a  program  based 
on  the  entitlement  principle,  that  requiring  youths  to  manifest  certa 
commitments  and  competencies  as  a  condition  of  support  is  workable,  a 
that  educational  institutions  must  modify  their  programs  to  make  the 
entitlement  principle  work. 

The  fact  that  the  entitlement  demonstration  did  not  lead  to  a 
full-scale  national  program,  is  not  troubling  to  most  insiders.  Nat 
Semple,  the  staff  person  who  had  probably  a  larger  stake  in  the 
entitlement  demonstration  than  most,  says,  "The  political  realities  c 
1981  were  that  you  weren't  going  to  get  anything  through  Congress  wit 
the  word  "entitlement"  in  it.  Also,  there  was  one  serious  design  fla 
in  the  entitlement  program  that  required  attention:  the  fact  that  whe 
the  subsidy  ran  out,  a  lot  of  employers  just  gave  kids  pink  slips.  1 
demonstration,  though,  had  effects  well  beyond  the  evaluation,  it 
legitimized  the  idea  that  standards  were  fair  and  effective." 

Another  view  of  the  influence  of  knowledge  development  comes  froir 
the  Brandeis  staff,  who  remain  the  single  repository  of  knowledge 
development  products,  the  main  synthesizers  of  that  evidence,  and  one 
of  the  few  organizations  created  by  that  process  that  still  exist. 
Andrew  Hahn  describes  the  influence  this  way.  "Before  YEDPA  and 
knowledge  development  people  who  worked  in  the  youth  employment  field 
basically  had  no  common  professional  identity.  One  effect  of  knowled 
development  was  to  put  a  large  infusion  of  resources  behind  the 
creation  of  a  professional  constituency  for  youth  programs.  That  is 
the  first  step  in  raising  the  standards  in  the  field  to  the  point 
where,  as  in  education,  you  can  start  to  expect  people  to  perform 
effectively."  Brandeis 's  current,  privately  funded  work  is  training 
and  technical  assistance  for  youth  practitioners;  the  network  they  us 
to  deliver  these  services  is  constructed  from  people  and  organization 
involved  in  YEDPA  and  the  knowledge  development  effort. 


Taggart  takes  yet  another  view  of  the  influence  of  knowledge 
development.  By  1979-1980,  he  had  evolved  a  longer-run  strategy  for 
using  research  and  technical  assistance  to  raise  the  quality  of  youth 
employment  programs,  consistent  with  his  pessimism  about  the  ability  of 
practitioners  to  discover  more  effective  techniques  by  themselves.  The 
idea  was  that  the  evaluations  of  discretionary  knowledge  development 
projects  and  the  activities  of  intermediaries  would  produce  a  list  of 
discrete  program  options.  Taggart  uses  the  term  "cookie  cutter 
programs"  to  describe  these  options.  Different  settings  would  require 
different  combinations  of  options,  given  their  youth  populations,  mix 
of  organizations,  and  employment  problems.  The  intermediaries  would 
function  as  technical  assistance  agents,  under  contract  with  localities, 
to  deliver  pieces  of  a  program. 

With  the  demise  of  the  network  of  organizations  created  by  the 
knowledge  development  process,  this  mechanism  failed  to  materialize. 

But  Taggart's  own  activities  now  focus  on  the  use  of  computer  technology 
to  construct  education  and  training  programs  for  high-risk  youths  from 
the  available  body  of  packaged  curricula.  Among  his  clients  are  local 
councils  created  under  JTPA. 

Against  this  relatively  sanguine  view  of  the  influence  of  knowledge 
development  is  arrayed  a  more  pessimistic  view,  which  takes  its  point 
of  departure  from  assessments  of  the  methodological  quality  of  knowledge 
development  activities  and  their  payoff  in  terms  of  scientifically 
verifiable  results.  Michael  Borus,  a  researcher  from  Rutgers,  has 
reviewed  research  on  employment  programs  for  high-risk  youths,  including 
the  Neighborhood  Youth  Corps,  the  Job  Corps,  and  a  number  of  discretion¬ 
ary  knowledge  development  projects  under  YEDPA.  He  found  serious 
methodological  flaws  in  most  impact  evaluations  of  these  programs — 
including  low  response  rates,  lack  of  adequate  comparison  groups,  and 
rudimentary  development  of  treatments — and  little  evidence,  outside  of 
Job  Corps,  of  positive  effects. 

He  concludes  that  no  progress  has  been  made  in  creating  effective 
programs,  and  that,  because  of  a  lack  of  methodological  and  substantive 
sophistication,  policy  makers  and  program  administrators  continue  to 
make  the  same  mistakes  with  each  new  initiative.  His  recommended 
solutions  include  evaluating  only  fully  implemented  programs  and  using 
"true  experimental  designs,"  carefully  designed  and  implemented  data 
collection  instruments,  benefit-cost  analyses  of  program  effects,  and 
planned  variations  in  program  design  (Borus,  1984). 

Between  the  sanguine  view  of  policy-  and  program-oriented 
researchers,  on  the  one  hand,  and  the  unrelenting  skepticism  of  the 
academic  research  community,  on  the  other,  lies  a  vast  gulf  of 
misunderstanding,  disagreement,  and  conflict  over  what  constitutes 
"useful"  knowledge.  For  policy  staff  and  program-oriented  researchers, 
knowledge  is  useful  when  it  helps  to  solve  immediate  problems  that 
legislators,  administrators,  and  practitioners  think  need  solving. 
Knowledge  comes  in  many  forms — logic,  insight,  operating  skill, 
political  intelligence,  and  empathy,  to  name  a  few — only  one  of  which 
is  social  science  research.  Creating  new  knowledge  depends  on  a  prior 
investment  in  programs  and  institutions  to  deliver  them.  Research 
methods  are  only  useful  insofar  as  they  are  instrumental  in  solving 
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problems;  when  they  get  in  the  way  of  institution  building  and  j: 
solving,  they  should  be  modified.  For  the  social  scientists,  kr 
is  useful  only  when  it  can  be  verified  and  replicated  with  knowr 
of  certainty.  Methodological  rigor  is  a  prior  condition  for  an^ 
knowledge.  Problem  solving,  whether  in  policy  or  in  practice,  i 
meaningless  unless  it  involves  the  systematic  accumulation  of  r€ 
research  over  time. 

As  noted  at  the  outset  of  this  paper,  these  disagreements  he 
rehearsed  with  monotonous  regularity  in  virtually  every  large-sc 
policy  research  effort  since  the  1960s,  with  only  a  modest  recoc 
of  the  common  ground  between  the  two  views.  The  arguments  are  c 
cated  by  ominous  attributions,  on  both  sides,  of  political  agenc 
personal  ambitions.  Policy  and  program  enthusiasts  are  accused 
social  science  researchers  of  "advocacy"  (as  if  it  were  possible 
an  effective  practitioner  without  being  an  advocate)  and  of  usin 
public  funds  to  further  private  agendas  (as  if  social  scientists 
not  benefit  from  doing  research  on  program  ineffectiveness) .  Sc 
scientists  are  accused  by  policy  and  program  advocates  of  being 
chronically  in  opposition  to  whatever  the  prevailing  conventions 
wisdom  is  and  of  putting  their  own  peculiar  tools  of  the  trade  a 
the  interests  of  regular  folks  (as  if  advocates  never  did  the  sa 
thing) . 

These  debates  are  inevitable,  in  some  cases  useful,  and  almc 
always  amusing.  But  they  often  do  not  shed  much  light  on  the  la 
questions  of  how  to  make  judgments  about  the  investment  of  the  p 
money  in  large-scale  research  and  development  enterprises,  such 
youth  employment  knowledge  development  effort.  These  larger  que 
often  broach  the  diffuse  and  difficult  subjects  of  political,  or 
zational,  and  management  strategy — subjects  in  which  neither  soc 
scientists  nor  policy  advocates  believe  they  have  a  comparative 
advantage.  Yet,  as  this  analysis  makes  clear,  large-scale  reses 
development  enterprises  succeed  or  fail  based  not  on  people's  fe 
commitment,  nor  methodological  orthodoxy,  but  on  how  skillfully 
make  strategic  decisions. 


GUIDANCE  FOR  THE  FUTURE 

At  the  outset,  I  posed  four  broad  questions  raised  by  the  yo 
employment  knowledge  development  effort:  What  constitutes  "usef 
knowledge?  What  should  be  the  relationship  between  the  delivery 
services  and  the  discovery  of  effects?  What  are  the  political  a 
organizational  correlates  of  successful  accumulation  of  knowledg 
what  payoffs  should  we  expect  from  large-scale  research,  demonst 
and  evaluation  efforts?  In  the  tentative  answers  to  these  quest 
lie  whatever  guidance  the  knowledge  development  effort  has  to  of 
future  policy  makers,  administrators,  and  researchers. 


Useful  Knowledge 


Running  through  the  knowledge  development  process  is  a  tension 
between  knowledge  acquired  through  social  science  and  knowledge  based 
on  practical  insight — a  tension  between  science  and  ordinary  knowledge. 
When  House  members  asked  the  Department  of  Labor  to  "find  out  what 
works,"  they  stated  their  concerns  as  a  potpourri  of  questions  and 
problems.  Some  of  those  questions,  such  as  how  to  solve  structural 
unemployment  among  young  people,  implied  sophisticated,  long-term 
research.  Others — the  effects  of  specific  training  and  job-search 
activities,  for  example — implied  shorter-term  project  evaluations.  The 
congressional  mandate  did  not  take  account  of  the  vast  differences  in 
those  questions,  nor  the  time  and  resources  required  to  answer  them. 

The  questions  specified  by  the  House  were,  from  a  research  perspective, 
exceedingly  vague.  They  provided  little  guidance  for  what  the  Congress 
meant  by  "finding  out  what  works."  Assuming  that  Congress  meant  rigor¬ 
ous  research  when  it  said  "find  out  what  works"  probably  overstates  the 
sophistication  of  Congress's  concern.  Congress  was  more  interested  in 
generating  a  variety  of  practical  activities  addressed  to  youth  employ¬ 
ment  than  in  setting  the  conditions  for  rigorous  social  research.  On 
this  score  the  House  and  Senate  agreed.  The  objective  was  to  launch  a 
ide  variety  of  activities  and  see  if  they  could  survive  administra¬ 
tively  and  politically.  In  the  words  of  a  House  staff  member,  "finding 
out  what  works"  meant  "let  a  thousand  flowers  bloom,"  not  the  conduct 
of  rigorous  research. 

When  members  of  Congress  said  "find  out  what  works,"  they  had  in 
mind  nothing  more  complicated  than  demonstrating  whether  new  programs 
could  be  instituted  administratively  and  whether  young  people  could 
find  useful  work  in  the  process  of  participating  in  them.  Larger,  more 
sophisticated  research  questions  were  embedded  in  this  basic  concern, 
but  were  not  central  to  Congress's  thinking.  With  certain  routine 
qualifications,  the  answer  to  the  questions  posed  by  Congress,  after 
three  years  of  research  and  demonstration,  was  "yes."  Knowledge  of 
this  kind  is  far  from  trivial,  even  though  it  does  not  meet  many  social 
scientists'  theoretical  or  methodological  standards. 

Congress  had  other  important  items  on  its  agenda  beyond  finding  out 
what  works.  Distributive  politics — by  age,  by  region,  by  constituency 
group,  by  federal  agency,  and  by  level  of  government — was  Congress's 
major  concern.  The  legislative  language  and  history  of  YEDPA  manifested 
far  more  attention  to  the  distribution  of  money  among  competing 
interests  than  it  did  to  discovering  solutions  to  youth  unemployment. 
Making  the  CETA  system  more  responsive  to  the  problems  of  youths  was 
another  agenda  item.  By  targeting  youths  for  special  concern.  Congress 
was,  in  effect,  telling  the  Department  of  Labor  and  the  CETA  system 
that  they  had  not  paid  adequate  attention  to  the  problems  of  youths. 
Still  another  agenda  item  was  using  federal  funds  to  make  the  schools 
and  the  employment  and  training  system  work  more  closely  together. 

From  the  point  of  view  of  certain  members,  the  gap  between  schools  and 
CETA-funded  organizations  was  inexcusable  and  should  be  closed. 

Each  of  these  items  brought  with  it  a  collection  of  problems  that 
Taggart  and  his  staff  had  to  solve  in  the  implementation  of  YEDPA. 


Failing  to  address  these  items  would  have  meant  failing  to  resp 
the  manifest  concerns  of  Congress. 

One  can  argue  that  Congress  was  irresponsibly  vague,  that  i 
to  provide  the  necessary  guidance  in  structuring  a  research  age 
that  it  undermined  the  possibility  of  finding  out  what  works  b} 
too  many  other  items  on  the  agenda.  But  these  arguments  all  mi 
essential  point:  Congressional  action  requires  coalitions;  coa] 
politics  requires  vagueness  and  multiple  agenda  items.  In  some 
instances,  as  YIEPP  illustrates,  the  demands  of  coalition  polit 
the  demands  of  rigorous  research  are  not  incompatible.  One  car 
expect  them  to  be  compatible  in  all,  or  even  most,  instances, 
knowledge  of  politics,  in  other  words,  should  shape  our  sense  c 
we  can  feasibly  expect  of  Congress  in  setting  the  initial  condi 
large-scale  research  on  social  problems. 

Ordinary  knowledge  of  administration  also  played  an  imports 
in  the  knowledge  development  process.  Federal  employment  and  t 
programs  are  administered  through  units  of  state  and  local  gove 
which  are  in  some  senses  autonomous,  but  which  also  assume  the 
authority  of  the  federal  government  to  make  contracts  for  the  d 
of  services. 

When  a  shift  in  policy  creates  new  demands  on  that  system, 
units  are  entitled  to  ask  a  host  of  practical  questions  about  t 
consequences  of  those  demands.  How  should  new  programs  be  mesh 
existing  delivery  structures?  How  should  the  competing  demands 
services  for  youths  and  adults  be  sorted  out  administratively, 
organizationally,  and  politically  at  the  local  level?  If  local 
employment  training  programs  are  supposed  to  be  coordinated  wit 
educational  systems,  what  is  acceptable  evidence  of  coordinatio 
how  have  other  jurisdictions  responded  to  the  requirement?  If 
people  are  to  be  given  clear  expectations  of  performance  as  a  c 
for  participation  in  employment  programs,  what  constitutes  sati 
performance  and  what  happens  to  those  young  people  who  do  not  n 
expectations? 

Again,  these  questions  are  relatively  far  removed  from  the 
ventional  social  science  questions  about  Treatment  A  and  Treatm 
but  they  describe  knowledge  that  plays  an  important  role  in  adc 
Congress ' s  concerns  about  whether  new  programs  can  be  made  to  w 
administratively.  Moreover,  since  the  administrative  structure 
composed  not  just  of  functionaries  working  under  contract  to  th 
federal  government,  but  also  of  governors,  mayors,  legislators, 
members,  and  the  like,  who  are  elected  officials  in  their  own  r 
these  people  are  entitled  to  answers. 

If  we  probe  far  enough  into  the  administrative  structure,  w 
eventually  reach  the  people  who  call  employers  to  ask  if  they  v; 
willing  to  hire  a  young  person,  who  teach  reading,  multiplicati 
long  division  to  18-year-old  dropouts,  who  try  to  find  housing 
young  man  who  is  sleeping  in  his  car,  and  who  try  to  find  child 
for  a  young  woman  who  is  about  to  leave  the  welfare  roles  and  s 
working  as  an  orderly  in  a  nursing  home. 

These  people  ask  a  different  order  of  question.  If  we  add 
section  to  our  remedial  General  Equivalency  Diploma  course,  who 
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get  to  teach  it?  If  we  are  expected  to  get  rid  of  kids  whose  attendance 
and  academic  performance  are  poor,  how  do  we  keep  our  enrollment  at  a 
high  enough  level  to  meet  our  placement  objectives?  Is  there  a  way  to 
combine  the  teaching  of  elementary  math  with  training  in  the  use  of 
common  measurement  tools?  Is  it  okay  to  send  a  bright,  but  poor  and 
neglected,  kid  to  the  academic  program  at  the  local  community  college 
rather  than  to  a  job  placement — will  it  count  against  our  placement 
results?  These  questions  are  also  somewhat  removed  from  the  Treatment 
A  versus  Treatment  B  questions  of  social  scientists.  But  if  someone 
cannot  answer  these  questions,  it  is  highly  unlikely  that  the  designs 
set  in  motion  by  Congress  will  be  translated  into  employment  for 
disadvantaged  young  people,  or  that  the  application  of  research  methods 
to  employment  programs  will  yield  information  useful  to  policy  makers. 

What  constitutes  "useful  knowledge,"  then,  depends  on  where  you 
stand  in  the  complex  system  of  relationships  that  operates  on  the  youth 
employment  problem.  From  this  premise,  three  conclusions  follow: 

First,  only  a  small  part  of  what  the  system  as  a  whole  regards  as 
useful  knowledge  meets  the  social  scientist's  definition  of  useful 
knowledge.  Second,  ordinary  knowledge,  in  the  form  of  answers  to 
practical  questions  about  whether  things  can  be  done,  is  a  precondition 
for  more  sophisticated  forms  of  knowledge,  like  that  resulting  from 
social  experiments.  And  third,  if  political  and  administrative  systems 
fail  to  accumulate  ordinary  knowledge,  they  will,  with  absolute 
certainty,  fail  to  accumulate  scientific  knowledge. 

The  notion  that  social  problem-solving  requires  the  faithful 
application  of  social  science  methods  to  policy  decisions,  then,  is  not 
so  much  wrong  as  it  is  incomplete.  Social  science  deals  in  a  kind  of 
knowledge  that  is  derivative  of,  and  dependent  on,  other  kinds  of 
knowledge.  Failing  to  distinguish  between  ordinary  knowledge  and 
scientific  knowledge,  and  failing  to  understand  the  role  that  ordinary 
knowledge  plays  in  the  creation  of  scientific  knowledge,  is  the  single 
largest  problem  with  social  science  in  the  service  of  policy  making. 

As  an  exercise  in  the  creation  and  codification  of  ordinary  knowledge, 
the  knowledge  development  process  was  a  qualified  success — at  least  in 
the  eyes  of  people  who  regard  ordinary  knowledge  as  important.  As  an 
exercise  in  the  application  of  social  science  methods  to  the  problem  of 
youth  employment,  it  was  less  successful,  but  by  no  means  a  complete 
failure. 

Whatever  its  other  defects,  the  knowledge  development  process  did 
reflect,  in  its  design  and  execution,  the  distinction  between  ordinary 
knowledge  and  scientific  knowledge.  Taggart  observed  that  the  applica¬ 
tion  of  social  science  methods  to  early  YEDPA  projects  was  "researching 
ineffectuality,  not  intervention."  He  observed  later  that,  for  all  its 
defects,  the  knowledge  development  effort  produced  more  social  science 
on  employment  questions  than  any  previous  federal  intervention.  His 
understanding  of  the  limits  of  the  existing  delivery  system  led  him  to 
take  a  skeptical  view  of  the  possibilities  for  experimentation  and  to 
focus  on  creating  the  prior  conditions  for  scientific  knowledge.  On 
the  one  hand,  this  focus  resulted  in  what  seemed,  from  the  point  of 
view  of  social  science,  a  disproportionate  investment  in  activities 
that  did  not  produce  "results"  in  the  form  of  clear  treatment-control 


the  Congress,  which  authorized  the  program  to  start  with. 

At  a  minimum,  then,  it  seems  that  future  large-scale  emplc 
research  and  demonstration  projects  should  begin  with  a  frank 
acknowledgment  that  experimentation  is  the  final  stage  of  some 
effort  to  codify  ordinary  knowledge,  not  the  first  step  in  fir 
what  works.  Doing  research  and  demonstration  projects  involve 
large-scale  investment  over  a  long  period  of  time  in  creating 
conventional  wisdom,  translating  it  into  structures  and  belief 
behavior,  and  then  (after  a  fashion)  subjecting  it  to  some  sor 
rigorous  empirical  test. 

Beyond  this  minimum  condition,  it  seems  reasonable  to  pron 
actively  the  notion  that  different  levels  of  knowledge  are  rec 
mount  large-scale  research  and  demonstration  projects,  and  the 
research  is  only  one  way  of  gathering  the  necessary  knowledge, 
expedients  are  often  the  most  effective,  like  practitioners'  v 
regularly  scheduled  congressional  visits  to  pilot  projects,  an 
head-to-head  discussions  among  administrators,  practitioners, 
researchers.  All  of  these,  and  more,  occurred  in  the  knowledg 
ment  process.  Whether  they  are  understood  as  legitimate  parts 
knowledge  development  in  retrospect  is  problematical.  When  th 
of  the  knowledge  development  process  are  culled  for  "hard"  cor 
about  what  works,  these  parts  of  the  process  are  often  lost. 


Delivering  Services  and  Discovering  Effects 

Another  important  tension  running  through  the  knowledge  de 
process  is  that  between  delivering  services  to  constituents  ar 
the  long-term  benefits  of  those  services  for  disadvantaged  you 
for  society  at  large.  Most  descriptions  of  YEDPA  begin  with  t 
statement  that  its  purpose  was  to  find  out  what  works  in  getti 
high-risk,  disadvantaged  youths  into  the  labor  market.  As  we 
seen,  this  is  not  so  much  an  inaccurate  reading  of  the  intent 
Congress  as  it  is  an  incomplete  one.  Certain  members  of  the  E 
a  genuine  interest  in  finding  out  what  works,  but  that  interes 
also  rooted  in  a  politically  motivated  desire  to  restrain  the 
enthusiasm  for  spinning  out  new  programs.  Most  key  Senators  t 
they  knew  what  to  do  and  saw  YEDPA  as  the  vehicle  for  doing  it 
compromise  between  the  House  and  Senate  incorporated  both  the 
tentativity  and  the  Senate's  commitment  to  specific  solutions, 
importantly,  though.  Congress's  charge  to  DOL  made  clear  that 
resources  were  to  be  deployed  to  support  the  network  of  consti 
that  had  grown  up  around  employment  training  programs.  If  DOI 
in  that  mission,  the  issue  of  "what  works?”  would  be  moot,  sir 
would  be  no  political  constituency  to  support  youth  programs  i 
next  round  of  congressional  debate.  While  finding  out  what  wc 
an  important  purpose  of  YEDPA,  delivering  services  to  politica 
stituencies,  state  and  local  jurisdictions,  employment  trainin 
organizations,  and  disadvantaged  youths  was  instrumental  to  th 


purpose.  Research  and  development  without  a  political  constituency  is 
of  little  practical  use  to  elected  policy  makers. 

Most  of  the  money  spent  on  knowledge  development  was  not  spent  on 
research.  It  was  spent  on  providing  jobs,  training,  and  education  to 
disadvantaged  youths.  Most  of  the  decisions  about  which  organizations 
would  receive  YEDPA  discretionary  funds  were  not  based  on  the  proven 
research  capacity  of  those  organizations,  or  even  the  expected  payoff 
of  the  funds  in  research  results,  in  fact,  most  organizational  recipi¬ 
ents  were  chosen  on  the  basis  of  the  constituencies  they  represented. 
Within  the  vast  collection  of  projects  that  knowledge  development 
comprised  were  a  limited  number  of  projects  chosen  explicitly  for  their 
research  value — some  on  the  basis  of  congressional  intent,  some  on  the 
basis  of  OYP's  policy  research  agenda.  It  was  in  this  limited  array  of 
projects  that  the  research  payoff  of  knowledge  development  was  to  occur. 

One  can  argue  about  whether  the  research  agenda  was  well  formulated, 
whether  the  right  projects  were  chosen  and  developed  in  the  right  ways, 
whether  the  proportion  of  constituency-based  projects  was  too  large,  or 
whether  the  right  organizations  were  represented  in  the  constituency- 
based  projects.  But  it  is  difficult  to  argue  with  the  fact  that  most 
of  what  goes  on  in  research  and  development  activities  of  the  scale 
represented  by  YEDPA  consists  of  delivering  services  to  constituents, 
not  doing  research.  It  is  also  difficult  to  argue  with  the  fact  that 
creating  political  constituencies  is  an  important  part  of  the  process 
of  getting  from  research  to  a  change  in  policy. 

This  intimate  connection  between  delivering  constituent  services 
and  discovering  effects  did  not  elude  Congress,  nor  did  it  elude 
Taggart  when  he  deployed  YEDPA  discretionary  money.  It  did,  however, 
seem  to  elude  many  of  the  social  scientists  and  policy  analysts  who 
criticized  the  knowledge  development  effort.  The  confusion  between 
"advocacy"  and  "research"  troubled  some,  as  did  the  raggle-taggle 
quality  of  the  research  in  many  of  the  demonstration  projects.  Anxious 
to  show  that  social  science  could  deliver  clear,  policy-relevant 
guidance,  they  failed  to  see  that  the  delivery  of  services  was  driving 
research,  not  vice  versa. 

There  is  vicious  paradox  in  the  use  of  social  science  rhetoric  to 
justify  social  intervention.  YEDPA  is  described  as  an  attempt  to  find 
out  what  works,  when  in  fact  it  was  an  attempt  to  deliver  services  to 
constituents  while  at  the  same  time  finding  out  what  works.  Because 
many  people,  even  the  politically  sophisticated  who  presumably  know 
better,  accept  that  the  primary  purpose  was  to  find  out  what  works,  the 
"mere"  delivery  of  services  becomes  tainted.  It  is  not  enough  to  get 
the  money  out  to  the  right  people  and  to  get  the  right  organizations 
involved  in  searching  for  solutions  to  the  problems  of  disadvantaged 
youths.  If  the  delivery  of  services  does  not  add  significant  new 
knowledge  to  social  science,  or  provide  solutions  to  the  problem  of 
structural  unemployment,  it  is  a  failure.  Anything  short  of  significant 
new  social  science  knowledge  is  just  pork  barrel.  There  is  nothing 
wrong  with  aspiring  to  significant  new  social  science  knowledge,  or  to 
long-term  solutions  to  structural  unemployment.  The  problem  occurs 
when,  aspiring  to  these  things,  we  conclude  that  merely  providing  jobs, 
training,  and  education  to  disadvantaged  youths,  and  merely  building  a 


professional  constituency  with  an  interest  in  providing  those  s 
means  that  policies  have  failed.  When  this  happens,  the  gulf  b 
science  and  politics  widens  irreparably. 

The  fact  that  we  find  it  easy  to  discredit  interventions  th 
merely  deliver  services,  but  difficult  to  find  scientifically  v 
solutions  to  chronic  social  problems,  may  mean  that  we  have  got 
sophisticated  in  using  the  rhetoric  of  social  science  to  justif 
intervention.  Until  the  "solutions"  come  along,  we  may  simply  : 
do  a  better  job  of  delivering  services.  Rather  than  arguing  th 
large-scale  social  interventions  will  result  in  solutions  to  ch. 
problems,  we  may  want  to  say  that,  while  we  are  working  on  the 
problems,  we  intend  to  see  that  some  number  of  disadvantaged  yoi 
people  get  access  to  jobs,  training,  and  education.  If  we  fail 
more  ambitious  task  of  finding  scientifically  valid  solutions,  1 
at  least  succeeded  in  delivering  services  and  at  creating  a  con 
committed  to  search  for  the  solutions. 

In  practical  terms,  researchers  and  policy  makers  alike  sho 
moderate  their  use  of  social  science  rhetoric  to  justify  social 
vention.  Finding  out  what  works,  in  the  scientific  sense,  requ 
long-term  investment  in  practical  knowledge  as  well  as  research 
that  investment  is  not  possible,  then  we  should  not  expect  to  f 
solutions  to  chronic  social  problems.  In  the  meantime,  merely 
delivering  services  may  be  the  best  we  can  do. 


Political  and  Organizational  Correlates 

Laurence  Lynn  (1981b),  in  his  book  Managing  the  Public's  Bu 
argues  that  the  alleged  failures  of  public  management  are  as  mu< 
result  of  poorly  framed  policies  as  they  are  of  incompetent  adm 
tors.  The  initial  conditions  set  for  public  servants  often  mak» 
success  unlikely.  There  is  probably  no  better  illustration  of 
argument  than  YEDPA.  DOL  was  given  four  new  youth  programs  to  . 
ment.  It  was  directed  to  expand  two  existing  programs  dramatic, 
and  it  was  given  a  large  amount  of  discretionary  money  to  find  < 
works  for  disadvantaged  youths — all  with  a  1-year  authorization 
programs  were  reauthorized  in  1978,  but  by  that  time  the  Carter 
administration  had  launched  the  Vice  President's  Task  Force  on  ' 
Employment,  with  instructions  to  produce  a  new  youth  employment 
by  the  following  year.  The  pressure  mounted  within  the  adminis 
to  produce  results  that  simply  were  not  there.  By  1980,  as  the 
research  and  demonstration  agenda  was  beginning  to  produce  resu 
presidential  election  brought  a  reversal  of  the  mandate  under  wl 
YEDPA  was  launched.  Each  of  these  events  can  be  explained  by  tl 
of  electoral  politics.  Electoral  politics  is  what  makes  policy 
possible.  But,  against  this  background,  it  should  surprise  no  < 
the  results  of  YEDPA  knowledge  development  fell  short  of  expect. 

In  a  practical  sense,  there  was  little  anyone  in  DOL  could  < 
control  the  volume  or  the  pace  of  the  political  demands  they  wei 
operating  under.  No  Sectretary  of  Labor  in  his  right  mind  woul< 
the  leading  members  of  the  U.S.  Senate  on  both  sides  of  the  ais" 


they  should  scale  back  their  ambitions.  DOL  faced  the  choice  of 
participating  in  the  authorization  of  YEDPA  and  sharing  in  the  credit, 
or  not  participating  and  getting  the  program  anyway.  Nor  would  a 
sensible  secretary  discourage  the  President  from  making  his  department's 
program  a  central  domestic  initiative  in  the  next  campaign.  There  were, 
strictly  speaking,  no  solutions  to  the  problem  of  external  demands  on 
YEDPA,  only  adaptations.  These  adaptations  carried  a  high  cost,  both 
to  the  delivery  system  and  the  production  of  useful  knowledge. 

The  political  lesson  from  YEDPA  is  relatively  clear ,  although 
probably  not  very  helpful.  The  scale  of  the  enterprise  was  incompatible 
with  the  pace  of  external  demands.  A  research  and  demonstration 
effort,  without  the  complex  structure  of  operating  programs,  could  have 
produced  modest,  short-term  results  within  the  amount  of  time  available. 
A  number  of  new  operating  programs  could  have  been  launched,  with 
limited  payoff  in  terms  of  new  research  and  development.  But  both 
demands  together  were  incompatible  with  the  time  and  institutional 
capacity  available.  It  is  instructive  that  the  entitlement  demonstra¬ 
tion,  the  one  piece  of  the  knowledge  development  effort  that  had  a 
relatively  clear  mandate,  a  finite  research  agenda,  and  a  considerable 
amount  of  institutional  research  capacity  behind  it,  came  the  closest 
to  meeting  congressional  and  executive  expectations.  It  is  also 
instructive  that  the  Job  Corps,  the  federal  youth  program  with  the 
greatest  institutional  maturity,  the  longest  history  of  trial  and  error 
(in  both  the  political  and  experimental  sense) ,  and  the  most  sustained 
evaluation,  is  the  example  that  most  policy  makers  reach  for  when  they 
try  to  define  successful  employment  policy.  The  more  diffuse  the 
mandate,  the  more  complex  the  research  agenda,  and  the  less  well-defined 
and  mature  the  institutional  capacity  of  the  delivery  system,  the  more 
difficult  it  is  to  deliver  services  and  do  research  on  them.  The  fact 
that  the  knowledge  development  effort  produced  as  much  as  it  did  is 
testimony  to  the  ability  of  many  people  to  operate  under  heavy  expecta¬ 
tions  and  unreasonable  time  constraints. 

On  the  organizational  side,  two  main  facts  stand  out:  the  lack  of 
capacity  within  DOL  to  manage  an  effort  of  the  scale  required  by  the 
YEDPA  mandate,  and  the  lack  of  explicit  consideration  of  organizational 
alternatives  to  the  one  finally  chosen.  The  lack  of  capacity  is  as 
much  a  commentary  on  the  nature  of  federally  managed  programs  as  it  is 
on  the  qualifications  of  DOL/OYP  staff.  There  were  limits  to  how  much 
research  expertise  one  could  expect  people  with  essentially  program¬ 
matic  backgrounds  to  bring  to  their  jobs.  But  even  with  the  best- 
qualified  federal  staff,  running  a  large-scale  federal  research  and 
development  program  is  an  exercise  in  indirect  management.  The 
programs  are  administered  by  people  whose  main  interest  is  in  deliver¬ 
ing  services,  the  research  and  evaluation  are  done  by  people  whose  main 
interest  is  in  devising  and  executing  designs.  The  job  of  the  federal 
administrator,  in  this  set  of  relationships,  is  to  mediate  conflicting 
interests  and  to  use  financial  and  regulatory  incentives  to  get  other 
people  to  do  their  jobs.  As  Taggart  can  testify,  this  is  devilishly 
difficult  work  for  which  few  people  are  equipped  by  experience  or 
training.  The  more  complex  the  system  of  administrative  relationships, 
the  more  skill  required  to  manage  it,  and  the  less  uniform  one  can 
expect  the  results  to  be. 
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In  other  words,  "lack  of  capacity"  can  mean  both  lack  of  qr 
staff  and  lack  of  direct  control.  Taggart's  administrative  str 
for  dealing  with  limited  capacity  was  to  create  capacity  in  oth 
organizations  and  manage  them  from  the  center.  It  was  well  sui 
OYP's  capacity,  in  both  senses  of  the  term.  But  it  had  the  wea 
all  such  strategies — it  was  vulnerable  to  variability  at  the  pe 
Some  external  alliances  worked  well,  because  they  were  well  org 
and  well  staffed;  others  did  not.  If  there  are  too  many  cases 
latter,  the  system  becomes  difficult  to  manage  from  the  center, 
solutions  to  this  problem  lie  either  in  working  on  a  much  small 
scale — an  alternative  not  really  available  under  YEDPA — or  in  g 
erating  more  capacity  on  the  periphery — something  that  takes  ti 
The  lack  of  an  explicit  consideration  of  organizational  alt 
to  the  one  that  evolved  is  not  unusual  in  federal  agencies.  No 
the  executive  branch  specializes  in  thinking  about  alternative 
organize  complicated  undertakings.  DOL  and  other  executive  act 
an  interest  in  YEDPA  were  preoccupied  with  larger  issues  at  the 
ning  of  the  effort.  Taggart  was  not  the  sort  either  to  pose  al 
natives  or  to  stand  back  and  wait  while  others  did.  He  did  wha 
considered  necessary:  he  consolidated  program  operations,  rese 
and  evaluation  in  OYP.  From  Taggart's  point  of  view  this  was  t 
solution.  It  is  not  clear,  however,  that  it  was  the  best  solut 
the  point  of  view  of  DOL,  Congress,  or  the  executive  branch.  N 
is  it  clear,  however,  that  any  of  the  alternatives  for  dispersi 
authority  among  other  DOL  units  would  have  worked  any  better, 
lesson  is  not  that  there  was  a  better  way  to  organize  knowledge 
ment.  The  lesson  is,  rather,  that  the  decision  of  how  to  organ 
an  effort  is  probably  the  most  important  high-level  executive  d 
that  cabinet-rank  officials  face.  It  merits  careful  analysis, 
not  get  that  analysis  in  this  instance. 


Payoffs 

A  few  conclusions  about  the  expected  payoffs  of  large-scale 
and  development  efforts  like  YEDPA  follow  from  this  analysis, 
is  that,  especially  when  solutions  to  chronic  social  problems  i 
changes  in  existing  institutions  or  the  creation  of  new  ones,  o 
knowledge  is  a  prior  condition  to  the  creation  of  scientific  kn 
Administrators  and  practitioners  need  to  know  what  to  do,  or  wh 
differently,  in  the  most  practical  sense,  before  they  can  begin 
in  systematically  different  ways.  Legislators  need  to  know  whe 
programs  can  be  administered  and  whether  benefits  can  be  delive 
before  they  can  make  judgments  about  whether  broader  social  pro 
can  be  solved.  Social  science  methods,  by  themselves,  do  not  d 
this  knowledge.  Investing  in  useful  knowledge,  then,  entails  i 
as  much  in  simple  information,  practical  intelligence,  and  netw< 
communication  as  in  research  and  evaluation.  Second,  there  is 
serious  danger  in  justifying  new  policies  on  the  basis  that  the; 
increase  our  knowledge  of  how  to  solve  chronic  problems,  rather 
merely  delivering  services  to  constituencies  and  individuals. 


lems  turn  out  to  be  resistant  to  social  science  inquiry ,  as  they 
lly  do,  the  failure  of  research  discredits  the  delivery  of  services, 
d,  there  is  little  anyone  can  do  to  limit  the  effect  of  shifts  in 
political  environment  on  large-scale  research  and  demonstration 
rts,  but  if  the  complexity  of  the  enterprise  is  inconsistent  with 
time  constraints  imposed  by  shifting  political  priorities,  the 
e  for  failures  should  be  shared  equally  by  elected  officials  and 
nistrators .  Fourth,  one  element  of  large-scale  research  and 
lopment  efforts  that  is  subject  to  executive  control  is  their 
nization.  Initial  decisions  about  how  to  organize  large-scale 
rts  should  be  subjected  to  explicit  analysis  and  high-level 
utive  scrutiny:  What  capacity  is  required?  What  organizations 
the  required  capacity?  What  capacity  needs  to  be  developed?  What 
ntives  are  available  for  mobilizing  that  capacity? 
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The  Social  Context  of  Youth  Employment  Programs 

Elijah  Anderson 


This  paper  is  based  on  field  work  in  urban  black  communities  and 
in-depth  ethnographic  interviews  with  individuals  familiar  with  youth 
employment  programs,  including  current  and  former  trainees,  superviso 
and  community  people  with  a  wealth  of  experience  with  employment  and 
unemployment.  Its  primary  purpose  is  to  provide  insights  into  the 
social  context  in  which  youth  employment  programs  operate.  In  part, 
this  is  a  conceptual  discussion.  What  follows,  then,  is  not  a  highly 
systematic  accounting  of  factors  related  to  specific  programs,  but  a 
more  general  set  of  considerations  of  cultural  and  community  factors 
that  have  likely  conditioned  the  effectiveness  of  youth  employment 
training  programs. 

The  paper  begins  with  a  brief  sketch  of  the  early  days  of 
on-the-job  training,  in  which  ethnic  whites  negotiated  the  labor 
market.  The  social  context  of  today's  job-training  programs  is  then 
described,  based  largely  on  the  interviews.  The  third  section 
discusses  the  values  held  by,  and  required  of,  participants  in  youth 
employment  programs.  A  summary  and  conclusions  section  ends  the  pape 


THE  EARLY  DAYS  OF  ON-THE-JOB  TRAINING 

In  the  1930s  the  New  Deal  instituted  what  could  be  called 
job-training  programs.  The  Works  Progress  Administration  (WPA) ,  the 
Family  Assistance  Program  (FAP) ,  and  other  "ABC"  programs  were 
initiated  to  alleviate  the  pain  and  suffering  caused  by  the  Great 
Depression.  In  post-Depression  America,  youth  employment  programs  as 
we  know  them  today  did  not  exist.  Rather,  employers  often  emphasized 
on-the-job  training. 

During  that  era,  many  employers  in  labor-intensive  industries 
relied  on  the  personal  references  of  family  and  trusted  employees  for 
their  recruitment  pool.  In  that  time,  the  apprentice  system,  or  an 


Elijah  Anderson  is  associate  professor.  Department  of  Sociology,  and 
associate,  director.  Center  for  Ethnographic  Studies,  at  the  Universit 
of  Pennsylvania. 


348 


349 


approximation  of  it,  was  also  of  prime  importance  for  industrial 
employment.  Various  white  ethnic  group  members,  the  primary  source  of 
labor  in  large  urban  areas,  tended  to  seek  out  their  own  kind  for 
invaluable  on-the-job  work  experience.  Both  the  instructor/mentor  and 
ethnic  peers  were  genuinely  interested  in  seeing  the  man  "work  out." 

And  the  man  usually  did  work  out,  for  the  extent  to  which  he  "fit" 
socially  with  a  supportive  work  group  usually  had  much  to  do  with  his 
success.  The  following  interview  with  an  82-year-old  Irish  American,  a 
still-practicing  machinist  and  automobile  mechanic,  gives  a  glimpse  of 
the  culture  of  on-the-job  training  in  those  years: 

In  the  30s  and  40s  the  guys  didn't  go  to  any  training  program. 

No,  they  didn't.  They  studied,  themselves.  They  had  a  certain 
natural  ability.  And  they  used  that  natural  ability.  In  other 
words,  I  know  a  lot  of  fellows  in  the  automobile  business. 

They  didn't  go  to  any  school.  They  didn't  go  to  nothin'.  But 
they  learned  as  they  worked.  They  didn't  know  if  this  car 
needed  a  carburetor,  they  didn't  know  if  it  needed  points. 

They  didn't  know  nothin'.  But  they  found  out.  They'd  say, 

"Yeah,  I  can  fix  your  car.  Bring  it  over  here."  Then  they'd 
get  busy  and  try  this  and  try  that,  and  finally  they'd  know  how 
to  do  these  things,  see.  They'd  learn  on  the  job,  and  the  job 
wasn't  supplied  by  the  government.  Guys  [employers]  gave  'em  a 
break.  They  didn't  know  what  else  to  do  with  'em.  What 're  you 
gonna  do  with  'em?  You  go  out  in  the  country,  the  country 
blacksmith,  he  was  the  guy  that  fixed  the  automobiles.  He  was 
a  general  mechanic.  As  a  rule,  a  good  blacksmith  is  just  a 
very,  very  clever  person,  because  he  knows  an  awful  lot  about 
the  materials,  the  iron,  steel,  and  so  forth,  tempering  the 
iron,  welding  and  all  that.  He  knows  all  these  things.  But  he 
learned  it  the  hard  way.  He  went  in  with  his  father  when  he 
was  a  little  ...  so  high.  And  he  grew  up  in  it.  His  father 
taught  it  to  him.  Now  my  father  taught  me  a  lot.  Much  of  the 
skills  in  that  day  were  passed  on  father  to  son  or  mother  to 
daughter . 

Uncles  and  fathers  would  help  the  youngsters.  If  they  didn't 
have  that,  somebody  took  them  in  to  help  out  in  a  store.  A  boy 
would  start  by  going  with  a  store,  and  they'd  start  out  by 
sweeping  the  floor ,  cleaning  the  place  up,  and  they'd  say  in  a 
year,  "You  can  wait  on  customers,"  and  after  a  while  they'd  be 
in  merchandising.  They'd  ease  up  the  system.  They  were  taught 
things.  Everybody  seemed  to  be  interested  in  something.  They 
were  interested  in  this  thing.  They'd  come  in  and  they  took  a 
hold . 

The  job  training  described  above  was  common  to  various  occupations, 
including  carpentry,  plumbing,  and  other  skilled  trades.  Such  job 
training  occurred  most  often  among  white  ethnics.  Blacks  and  other 
minorities  were  occasionally  employed  and  trained  this  wav  as  well,  but 
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requiring,  and  least  well-paid  occupations,  which  were  essentially  1< 
over  by  whites  who  had  preceded  them  (see  Spear,  1967;  Davis  and 
Haller,  1973;  Hershberg  et  al. ,  1981).  Many  blacks  who  were  able  to 
acquire  an  apprenticeship  in  occupations  such  as  plumbing,  masonry,  < 
carpentry  were  not  allowed  to  join  unions  or  to  practice  their  trade: 
the  way  white  ethnics  were  (see  Marshall,  1965).  Often,  blacks 
fortunate  enough  to  possess  such  skills  were  required  to  work 
independently,  and  at  times  sporadically,  at  less  than  union  scale. 
The  following  comments  of  a  70-year-old  black  wallpaper  stripper  are 
germane: 

I  learned  masonry  in  North  Carolina.  Down  there  I  could  find 
work.  Colored  people  often  did  this  type  of  work.  When  I  come 
to  Philadelphia  [at  approximately  30  years  of  age] ,  they 
[whites]  wouldn't  let  me  work.  I  couldn't  find  work  even 
though  I  was  qualified.  So  I  went  in  business  for  myself,  and 
started  hanging  wallpaper,  made  a  living  that  way.  I  don't  do 
that  no  more.  I  just  strip  paper,  now. 

Some  of  the  earliest  organized  job-training  situations  were 
developed  in  grade  schools,  YMCAs,  and  vocational  high  schools  servii 
working-class  youths.  In  shop  classes  boys  were  trained  to  run 
machines,  such  as  lathes,  and  girls  were  often  taught  sewing  and  hom< 
economics.  At  graduation  a  friend  of  the  family,  a  relative,  or  a 
teacher  would  serve  as  a  reference  for  the  prospective  worker.  In  tl 
way  schools,  friends,  and  families  provided  important  links  to  the 
workplace,  informally  shaping  the  work  settings  of  the  day  along  ethi 
and  cultural  lines  that  reflected  their  neighborhoods,  schools,  and 
families  (Hareven  and  Langenbach,  1978) . 

Sometimes  vocational  instructors  moonlighted  at  a  local  shop,  wh< 
they  were  "regular  guys,"  but  also  where  they  could  channel  their  ab! 
students  into  jobs.  A  person  trusted  in  one  place  was  usually  truste 
in  the  other.  Through  these  placements,  the  students  often  gained  a 
trade  for  life  and  affirmation  of  themselves  through  work.  Trainee  < 
instructor  alike  obtained  some  affirmation  of  self-worth  and  perhaps 
even  closer  identification  with  friendship,  neighborhood,  or  ethnic 
circles.  Such  channeling  helped  to  create  and  support  the  peculiar 
racial  and  ethnic  character  of  certain  occupations.  For  the  ethnic 
group  members,  these  effective,  informal  job-training  efforts  were 
important  steps  between  youth  and  adulthood.  They  were  effective  in 
part  because  they  were  heavily  sanctioned  by  those  involved,  but  als< 
because  they  were  part  of  a  social  system;  the  workplace  was  recepti\ 
to  them. 

Such  social  connections  and  placements  were  crucial  for  the 
effectiveness  of  early  employment-training  efforts.  People  entering 
such  relationships  often  did  so  on  the  promise  that  they  would  gain  ; 
job  in  return  for  their  involvement.  It  was  in  just  this  way  that 
young  men  and  women  placed  in  comparatively  rewarding  employment 
positions  could  begin  to  develop  what  would  become  lifelong  positive 
associations  with  work.  Furthermore,  in  these  circumstances  the  wori 
ethic  could  be  affirmed  and  reinforced,  not  only  for  the  individual 


placed  in  a  meaningful  job,  but  also  for  his  cultural  peers,  who  could 
look  forward  to  the  day  when  they  too  might  have  jobs. 

On  the  negative  side,  feelings  of  alienation  and  injustice  could  be 
generated  and  kept  alive  within  these  group  structures  when  people  were 
lot  pleased  with  their  jobs  or  the  way  in  which  they  were  treated.  In 
this  way  hope  and  expectations  were  formed  and  neighborhood  solidarity 
gained.  Unfortunately,  as  these  processes  occurred,  work  settings 
cecame  resistant  to  incursions  by  rival  ethnic  groups  and  almost 
Impenetrable  for  members  of  other  racial  groupings,  particularly  blacks 
(see  DuBois,  1899;  Spear,  1967;  Clark,  1973;  Hershberg  et  al.,  1981). 
Such  outlooks  and  the  employment  practices  consistent  with  them  led  to 
cacial  and  ethnic  competition,  conflict,  dominance,  and  subordination 
In  a  variety  of  jobs.  This  in  turn  gave  rise  to  such  evaluations, 
conceptions,  and  labels  as  the  "black  job,”  the  "white  job,"  "men's 
vork,"  and,  of  course,  "women's  work." 


MODERN  JOB-TRAINING  PROGRAMS 

In  the  1960s,  during  the  days  of  the  Kennedy  administration,  job 
training  became  more  formal,  and  government-sponsored  programs  were 
nore  firmly  established.  Bureaucratic  rules  were  developed  and 
elaborated,  and  a  variety  of  spin-offs  were  later  instituted  (see 
linzburg,  1980;  Stromsdorfer ,  1980).  Initially,  many  participants  in 
these  programs  were  ethnic  whites.  Over  time,  the  racial  and  ethnic 
identities  of  both  instructors  and  trainees  in  employment  programs 
oegan  to  change.  Colored  minorities  began  to  make  up  an  increasingly 
significant  portion  of  program  participants. 

Under  these  circumstances,  the  general  effectiveness  of  work¬ 
training  programs  was  severely  tested  and  often  found  wanting.  The 
solutions  for  the  employment  problems  of  white  ethnics  often  did  not 
vork  well  for  blacks  and  other  nonwhites.  In  the  earlier  period  the 
athnic  and  cultural  organization  of  the  ethnic  neighborhoods  was 
compatible  with  that  of  the  work  settings  into  which  the  trainees 
moved;  in  the  later  period  contrasting,  if  not  conflicting,  ethnic 
populations  were  expected  to  work  together.  Although  the  work  settings 
mad  formerly  been  receptive  to  white  trainees,  they  were  not  now  so  for 
clacks.  Discrimination  was  a  problem,  to  be  sure,  but  also  important, 
the  nature  of  the  world  of  work  was  undergoing  crucial  and  far-reaching 
changes. 

With  widespread  and  increasing  automation  and  technological 
development,  a  certain  social  fit  between  training  and  employment 
contexts  had  been  lost.  Moreover,  the  structure  of  employment 
cpportunities  that  had  awaited  the  ethnic  whites  was  declining  as  large 
numbers  of  blacks  and  Puerto  Ricans  attempted  to  negotiate  the  labor 
market  (see  Doeringer  and  Piore,  1971;  Wilson,  1980;  Hershberg  et  al., 
981).  Furthermore,  the  various  social  connections  to  the  workplace 
that  had  been  critical  to  the  successful  employment  efforts  of  whites 
were  largely  lacking  for  blacks.  It  is  this  lack  of  social  connections 
and  linkages  to  training  and  employment  contexts  that  continues  to  be 
an  important  consideration  in  the  effectiveness  of  current  job-training 
programs. 


Instructors  and  Trainees 


In  many  instances,  the  instructors  in  programs  of  the  1960s  were 
ethnic  whites  who  were  fond  of  remembering  how  they  "came  up  the  hard 
way,"  at  times  invoking  the  American  "bootstrap  theory"  of  social 
mobility  (see  Hershberg,  1981).  Increasingly,  however,  many  of  the  n< 
trainees  were  young  black  men  from  urban  ghettoes,  people  their  instri 
tors  could  readily  compare  negatively  with  advantaged  whites  and  labe: 
as  "out  to  get  something  for  nothing."  To  many  white  ethnics,  these 
young  black  men  represented  a  threat  (see  Blumer ,  1958;  Pettigrew, 
1980)  . 

In  earlier  times  when  mentors  taught  their  proteges  a  trade  or  wo: 
skill,  the  process  was  often  slow  and  guided  by  the  cautious  develop¬ 
ment  of  trust  among  participants.  The  "tricks  of  the  trade"  and  othe: 
occupational  secrets  usually  were  only  slowly  divulged  to  "worthy, " 
"likable,"  and  "able"  trainees,  evaluations  that  were  made  subjective, 
and  at  times  arbitrarily. 

When  young  black  men  were  introduced  into  this  type  of  job  trainii 
to  be  instructed  largely  by  white  working-class  instructors,  the 
scenario  became  extremely  complicated.  A  certain  amount  of  tension 
between  divergent  cultural  groups  may  be  anticipated  and  perhaps 
dismissed  as  normal  happenstance.  But  with  the  introduction  of  race 
and  the  resulting  competition  for  "power  resources,"  many  such 
instructors  were  no  longer  able  to  view  themselves  as  simply  passing  * 
skills  and  trades  to  deserving  youths  (see  Bonney,  1972;  Wilson,  1973 
Kornblum,  1974).  Rather,  the  instructor,  who  may  have  viewed  himself 
as  a  master  craftsman,  might  have  sensed  that  his  own  group  interests 
were  threatened  by  the  prospect  of  training  young  black  men  for  occup. 
tions  once  held  by  members  of  the  instructor's  own  ethnic  group.  The 
instructor  was  likely  to  experience  some  difficulty,  if  not  profound 
psychological  dissonance,  in  teaching  something  so  dear  to  him  as  his 
trade  to  people  generally  defined  as  outcasts  making  spirited  assault, 
on  areas  of  influence  and  privilege  traditionally  (and  legally) 
reserved  for  others  he  might  more  readily  identify  as  his  own  kind  (s< 
Blumer,  1958;  Goff man,  1963;  Higginbotham,  1978). 

Instructors  at  times  resolved  this  dissonance  by  approaching 
minority  trainees  with  a  dubious  attitude.  Doubtful  of  the  basic 
potential  of  ghetto  youths,  they  often  relied  on  racial  stereotypes  i 
their  dealings  with  them.  But  equally  important,  black  trainees  were 
often  suspicious  of  their  instructors,  at  times  believing  them  to 
harbor  racist  attitudes  and  approaching  them  only  with  a  certain  amoui 
of  hesitancy  and  caution.  What  was  ostensibly  begun  as  an  instructor 
trainee  relationship  sometimes  became  a  full-blown  racial,  ethnic,  an* 
class  contest. 

The  problem  of  social  friction  between  instructor  and  trainee  is 
just  one  problematic  area  among  many  that  must  be  addressed  to  gain 
insight  into  the  more  general  issue  of  the  effectiveness  of  job  pro¬ 
grams.  First,  in  addition  to  the  attitudes  of  teachers  toward 
students,  the  attitudes  of  the  trainees  must  be  examined,  what  is  th< 
manner  in  which  these  attitudes  are  expressed  in  both  the  job-trainin* 
context  and  on  the  actual  job?  Second,  it  is  necessary  to  examine  ttv 
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circumstances  in  which  the  problematic  attitudes  of  instructors  and 
trainees  are  expressed  and  to  gain  an  ethnographic  picture  of  the 
manner  in  which  often  conflicting  definitions  of  the  situation  meet  and 
become  resolved  or  are  left  unresolved. 


Sources  of  Conflict 

In  addition  to  what  might  be  viewed  as  a  problem  of  cultural 
background — the  issue  of  ethnic  or  class  friction  or  competition — there 
exists  a  more  manifestly  troublesome  aspect  of  the  social  "fit"  between 
instructors  and  trainees.  The  culture  of  the  job-training  program,  and 
perhaps  the  culture  of  any  school  situation,  clashes  with  the  culture 
of  the  ghetto  street.  The  hard-core  unemployed  are  often  the  embodi¬ 
ment  of  this  street  culture.  Even  to  the  casual  observer,  their  values 
appear  to  be  very  much  at  odds  with  the  dominant,  middle-class  value 
system  represented  and  often  invoked  by  the  staff  of  a  job-training 
program  (see  Liebow,  1967;  Hannerz ,  1969;  Wellman,  1977;  E.  Anderson, 
1978;  Auletta,  1982). 

Certain  manifestations  of  the  culture  of  the  hard-core  unemployed 
carry  over  into  the  job-training  setting  and  thus  contribute  to 
tensions  between  trainee  and  instructor.  For  instance,  numerous 
trainees  seem  to  have  difficulty  with  middle-class  concepts  of  time. 
From  the  perspective  of  the  staff,  many  seem  to  lack  interest  in  being, 
or  are  unable  to  be,  punctual;  they  seem  to  accept  tardiness  as  normal 
happenstance.  They  may  also  be  absent  from  class  much  of  the  time. 

Many  display  what  is  interpreted  by  instructors  to  be  a  "tough" 
demeanor;  they  appear  to  carry  a  chip  on  their  shoulder.  Some  trainees 
appear  to  have  trouble  dealing  with  authority  figures,  particularly 
white  male  instructors.  Instead  of  an  attitude  of  seriousness,  many 
youths  appear  to  take  a  cavalier  attitude  toward  the  program,  appearing 
simply  to  be  putting  in  time. 

These  (what  staff  members  often  call  irritating)  aspects  of  the 
trainee's  manner  of  self -presentation  aggravate  the  perhaps  already 
negatively  inclined  instructor,  who  may  be  so  inclined  for  his  own 
group-identification  reasons:  it  is  very  difficult  to  comprehend  the 
influence  of  long-standing  and  real  ethnic,  racial,  and  class  hostility 
in  the  current  job-training  setting.  But  it  is  an  "outsider"  class  of 
youths — black  ghetto  street  boys  and  young  men — who  by  their  life-style 
and  demeanor,  threaten  white  and  even  black  instructors  from  the  old 
working  class,  causing  them  to  maintain  a  certain  social  distance  in 
self-defense.  The  teacher-student  relationship,  particularly  in  an 
employment- training  program,  requires  a  profound  degree  of  trust  if  it 
is  to  succeed,  but  this  needed  trust  is  often  sorely  lacking,  which  is 
another  important  reason  that  many  of  the  programs  lack  effectiveness. 

At  the  same  time,  program  trainees  have  numerous  complaints  of 
insensitivity  on  the  part  of  instructors.  For  instance,  some  instruc¬ 
tors  are  said  to  close  and  lock  the  door  at  the  beginning  of  class, 
refusing  to  open  it  for  someone  who  is  five  minutes  late.  After 
traveling  the  10  subway  miles  from  the  north  Philadelphia  ghetto,  some 
youths  are  prepared  to  call  the  instructor's  actions  racist,  if  the 
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instructor  is  white,  or  antiblack,  if  he  is  black.  As  one  yout 
explains,  "Five  minutes  ain't  a  whole  lot  of  time."  But  the  in 
is  not  inclined  to  see  things  this  way.  The  instructor's  attiti 
be  that  this  black  youth  fits  into  the  category  of  a  person  try 
get  something  for  nothing,  without  putting  in  the  hard  work.  Ii 
some  youths  think  15  minutes  one  way  or  the  other  is  simply  not 
important,  or  even  that  missing  four  or  five  days  of  school  is  < 
negligible  import.  But  interrelated  with  the  issues  of  attenda 
punctuality  are  often  the  trainees'  basic  problems  of  a  chronic 
money  and,  thus,  of  reliable  transportation  to  the  job-training 
Unfortunately,  these  issues  are  likely  to  become  confused  and  i] 
preted  as  indicative  of  behavioral  laxity.  Many  of  the  hard-co 
unemployed  are  likely  to  receive  their  "carfare"  to  the  trainin' 
one  day  and  spend  it  all  in  the  next  day  or  so.  This  populatio; 
unlike  those  of  the  middle  class  or  even  the  working  class,  has 
unlimited  list  of  "necessities"  on  which  to  spend  money,  from  1 
food.  When  their  money  is  spent,  they  often  lack  a  means  of  tr; 
tion.  Then,  after  repeated  tardiness  or  absence  from  training 
they  fall  irretrievably  behind,  or  their  aggravated  instructors 
unsympathetically  judge  and  treat  them  so;  many  then  become  unw 
or  unable  to  participate  further. 

Feeling  discouraged  and  frustrated,  many  youths  become  conv 
that  the  instructor,  in  being  a  tough  disciplinarian,  is  not  al. 
supportive  or  interested  in  seeing  them  succeed.  The  instructo 
respond,  "Well,  if  this  was  a  job  and  you  were  getting  paid,  th« 
are  the  real  expectations.  You  must  be  on  time,  and  you  must  c 
every  day.  If  you  don't  come  every  day,  or  if  you  come  late,  t] 
you're  not  going  to  keep  that  job  for  very  long."  Such  a  lectu 
good  sense  to  instructors.  But  to  many  young  people  in  a  train 
context,  such  invocations,  at  times  sharp  tongued,  of  disciplin 
attendance,  and  punctuality  may  easily  be  taken  as  clear  eviden' 
prejudice.  Insensitive  to  these  perceptions,  and  often  with  a 
sense  of  commitment  to  discipline,  the  instructor  may  believe  i 
important  to  get  the  trainee  back  in  line. 

But  getting  the  youths  back  in  line  is  not  a  simple  task,  a< 
because  of  what  is  often  a  basic  lack  of  cultural  compatibility 
trainees  and  instructors,  particularly  as  instructors  are  prepa 
interpret  the  situation.  The  trainees  often  come  from  an  urban 
ment  that  has  not  prepared  them  to  adapt  easily  to  the  rules  an' 
etiquette  of  the  workplace.  Many  of  the  hard-core  unemployed  a 
socialized  and  conditioned  to  be  "tough"  in  their  encounters  wi 
men,  particularly  challenging  authority  figures  who  are  white, 
tend  to  have  little  faith  in  whites  generally.  Their  demeanor 
frequently  evolves  into  a  kind  of  arrogance  that  is  often  a  def 
display,  particularly  when  confronted  by  potential  threats  or  c'. 
to  their  independence  and  "manhood."  Such  a  demeanor  is  though 
many  to  be  absolutely  necessary  to  survive  the  mean  ghetto  stre' 

After  years  of  such  conditioning,  a  youth  meets  the  job-tra 
instructor.  In  this  situation,  the  youth  must  suddenly  change  i 
the  behavioral  patterns  gained  through  socialization,  patterns 
has  come  to  take  for  granted  and  to  value.  It  may  appear  to  hii 
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he  must  now,  in  effect,  humble  himself  in  the  face  of  authority  that, 
whether  assumed  by  a  black  or  white  person,  is  perhaps  of  dubious 
legitimacy.  The  value  of  changing  his  behavior  is  not  completely  clear 
to  him;  he  has  remarkably  little  faith,  though  perhaps  much  hope,  that 
deference  and  time  spent  in  the  training  program  will  result  in 
meaningful  employment. 

If  employment- training  programs  are  to  be  effective,  they  must 
deliver  what  trainees  want  most:  meaningful  employment.  Many  trainees 
must  indeed  be  taught  the  importance  of  discipline,  punctuality,  and 
good  attendance  in  the  workplace,  but  at  the  same  time,  instructors 
must  become  sensitized  to  the  special  problems,  cultural  or  otherwise, 
of  the  hard-core  unemployed.  The  instructor  should  be  able  to  recognize 
the  cultural  problems  noted  here  and  then  display  a  certain  sensitivity 
and  patience  in  searching  for  creative  and  effective  ways  to  teach  and 
remind  youths  of  their  particular  shortcomings  with  regard  to  the 
culture  of  the  workplace.  Moreover,  there  should  also  be  clear  and 
identifiable  rewards  for  the  trainees  and  their  supervisors  for 
effective  behavior  and  attitudes  displayed  in  the  training  context. 

Instead  of  sensitivity  toward  and  appreciation  of  the  cultural 
milieu  from  which  they  come,  however,  trainees  often  meet  with 
shortsighted  behavior,  derision,  strictness,  and  control  on  the  part  of 
the  instructor.  Instructors  may  feel  justified  in  a  tough  and 
defensive  reaction,  as  they  believe  there  is  often  a  need  to  compete 
for  authority  in  this  context.  In  their  invocations  of  discipline, 
they  often  promote  themselves  as  guardians  of  the  values  of  work, 
defending  those  from  their  students,  whom  they  must,  however,  simul¬ 
taneously  teach  and  ultimately  render  employable.  What  begins  as  an 
instructor-trainee  situation  may  quickly  deteriorate  into  a  contest  of 
ethnic,  racial,  or  class  authority. 

Significantly,  it  is  not  only  white  instructors  who  may  carry 
problematic  attitudes  into  job-training  situations,  increasingly,  many 
of  today's  instructors  are  black  and  have  often  emerged  from  traditional 
working-class  backgrounds.  The  job-training  program  is  likely  to  be 
made  up  of  black  trainees  and  black  instuctors.  The  black  instructors 
may  think  of  themselves  as  having  worked  hard  to  get  where  they  are. 
Having  themselves  made  it  through  hard  work  and  much  personal 
sacrifice,  they  may  be  inclined  to  be  prejudiced  against  unemployed 
black  youths.  Their  feelings  may  be  manifested  in  an  over zealous 
desire  to  turn  out  highly  successful  black  youths,  resulting  in  strong, 
and  at  times  arbitrary,  invocations  of  discipline  in  the  training 
process.  There  is  sometimes  a  fine  line  between  the  appropriate 
invocation  of  discipline  for  effective  management  of  training  and  the 
manifestation  of  class  prejudice  in  the  form  of  harassment. 


Casualties  of  the  Program 

Over  time,  some  young  people  who  participate  in  youth  employment 
programs  become  frustrated  and  demoralized  by  their  experiences.  They 
simply  become  worn  down  by  the  routine  of  the  program  and,  often  because 
of  their  inability  to  make  visible  "progress,"  become  disgusted  with 
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the  program  and  its  staff.  Progress  for  them  is  to  feel  equipi 
marketable  skills  that  will  give  them  a  chance  to  compete  effe< 
for  a  permanent,  well-paying  job.  Lacking  clear  signs  of  progi 
many  become  frustrated  and  resign  from  the  program,  at  times  ii 
attempt  to  retain  a  sense  of  manhood  and  independence.  In  so  c 
many  proclaim  they  would  rather  "give  it  up"  (trying  to  obtain 
than  "slave  for  the  man"  (to  engage  in  hard  labor)?  a  popular  c 
expression  for  job  is  "slave." 

On  leaving,  they  are  in  effect  "shaken  out"  of  the  program, 
in  discussing  the  program  with  any  interested  party,  they  of  ter 
their  worst  experiences  and  characterize  the  whole  program  as  1 
of  time."  In  bad-mouthing  the  program  to  other  members  of  the 
munity,  they  seek  affirmation  and  support  in  having  been  wise  c 
quit  the  program.  As  they  travel  through  the  community,  they  s 
have  anything  positive  to  say  about  the  program.  In  effect,  tl 
only  draw  the  cultural  boundary  between  the  streets  and  the  prc 
more  strongly  and  clearly.  Insofar  as  they  have  prestige  on  tk 
street,  they  then  influence  others  to  be  loyal  to  the  streets  k 
rejecting  the  programs. 

Significantly,  many  individuals  tend  not  to  specify  which  j: 
they  have  had  a  bad  experience  with,  and  their  listeners  often 
require  specifics.  In  such  instances,  "the  program"  sometimes 
to  almost  any  and  all  programs  in  existence.  There  is  a  tender 
community  people  with  no  first-hand  experience  to  lump  all  proc 
together,  not  distinguishing  between  programs,  be  they  federal, 
or  local.  Reports  on  a  program,  good  or  bad,  seem  to  be  readi] 
generalized. 

As  the  casualties  of  the  "program"  move  on,  they  fall  into 
situations  that  attract  them.  Some  develop  time-consuming  new 
aimed  at  financial  self-survival,  for  example  a  job  with  a  fast 
restaurant,  an  exterminating  company,  or  a  factory.  Chance  pic 
important  role  here.  If  employment  fails  to  materialize,  some 
have  been  known  to  involve  themselves  in  drug  dealing  and  other 
criminal  activity  for  financial  gain?  people  of  the  community  r 
make  an  association  between  idle  unemployment  and  crime.  Of  ter 
last  choice,  those  with  clear  law-abiding  intentions  may  attemf 
enlist  in  military  service,  but  often  they  are  rejected. 

Through  their  travels  about  the  city  and  the  local  communit 
find  it  necessary  to  maintain  that  their  decision  to  leave  the 
was  a  good  one.  A  working  conception  of  oneself  and  the  progrc 
develops,  complete  with  excuses  and  justifications  for  why  thin 
not  work  out  with  the  program.  In  this  instance,  many  conclude 
more  firmly  that  a  well-paying  job  for  them  was  simply  not  poss 
through  any  association  with  the  program. 

As  frustration  and  disappointment  grow,  the  program  also  1c 
relatively  mature  participants  who  have  a  measure  of  discipline 
often  the  motivation  to  succeed  at  using  the  program  for  obtain 
permanent  job.  In  fact,  this  is  the  initial  goal  of  many  of  tk 
entering  the  program.  But  when  they  fail  to  achieve  this  goal, 
serious,  and  perhaps  more  intelligent,  youths— those  with  a  cle 
of  options — move  on,  wanting  no  longer  to  tolerate  the  "abuse" 
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nsions  with  the  staff.  For  many,  the  main  problem  here  is  the 
ominent  failure  of  the  program  to  deliver  on  its  ostensible  promise; 
permanent  job. 

As  they  move  on,  the  casualties  leave  behind  in  the  program  many 
uths  who  possess  relatively  little  in  the  way  of  personal  or  social 
ills  that  will  enable  them  to  participate  effectively  in  a  job- 
aining  program.  They  leave  behind  those  who  are  not  so  highly 
tivated,  those  with  limited  options,  and  the  new  recruits.  Many 
rticipants  are  so  poor  they  have  hardly  enough  food  to  eat  or  even  a 
liable  residence;  alcohol  and  drugs  are  also  persistent  problems  for 
me. 

Program  directors  might  then  complain  that  the  pool  they  now  have 
nsists  of  too  many  "mental  defectives,  drug  addicts,  ex-cons,  retarded 
ople,  illiterates.9'  Such  views,  not  only  among  staff  but  also  among 
mmunity  people  and  prospective  trainees,  contribute  to  the  stigmatiza- 
on  of  the  program  and  ultimately  to  its  ineffectiveness. 


Values 

The  generalized  American  belief  in  "pulling  yourself  up  by  your  own 
otstraps"  appears  at  times  to  work  against  the  credibility  of 
vernment-sponsored  job-training  programs.  Strikingly,  "working  for  a 
ving,"  the  "bootstrap"  ideal,  and  the  avoidance  of  "government 
ndouts"  represent  values  that  many  black  and  other  minority  Americans 
are  with  others  (see  Hershberg,  1981).  Many  youths  would  like 
thing  better  than  to  realize  this  ideal,  and  they  work  very  hard  at 
hieving  it. 

When  such  highly  motivated  youths  become  involved  with  a  job- 
aining  program,  they  often  attain  a  measure  of  success.  In  their 
asses,  they  achieve  outstanding  records.  Highly  motivated  to 
cceed,  such  individuals  are  imbued  with  self-confidence  and  a 
sitive  outlook,  despite  the  distrust  and  discrimination  they 
counter.  They  appear  to  emerge  from  a  family  and  social  background 
at,  while  financially  poor,  places  much  emphasis  on  self-discipline, 
lf-esteem,  and  a  strong  belief  in  the  "work  ethic.'9  As  they 
gotiate  the  training  program,  they  very  favorably  impress  their 
achers.  When  the  teachers  learn  of  openings,  they  do  not  hesitate  to 
commend  such  youths  for  jobs.  It  is  for  these  individuals  that  the 
ogram  seems  most  effective.  They  tend  to  obtain  jobs  and  move  on  to 
gotiate  certain  areas  of  the  occupational  structure.  But  such 
dividuals,  emerging  as  they  do  from  backgrounds  of  poverty  and 
scrimination,  tend  to  be  rare. 

An  important  policy  issue  for  those  interested  in  increasing  the 
fectiveness  of  youth  employment  programs  is  that  of  how  to  instill 
e  attitudes  and  behavior  patterns  of  successful  individuals  into 
her  trainees.  This  would  require  serious  and  effective  training 
ssions  devoted  to  discipline  and  motivation.  But  there  must  also  be 
me  change  in  the  attitudes  of  staff  people  who  seem  to  expect  too 
ttle  from  minority  youth.  Youth  employment  programs  need  effective 
achers  who  possess  the  sophisticated  knack  for  discerning  the 
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unexhibited  potential  of  trainees  and  who  are  able  and  willing  to  help 
the  trainees  "find  themselves."  But  at  the  same  time,  program  staff 
must  be  willing  and  able  to  help  place  the  youth  in  meaningful 
employment  after  they  complete  their  training. 

Given  the  realities  of  the  employment  arena,  including  ethnic  and 
racial  competition  and  the  prospective  employer's  often  profound 
distrust  of  black  youths,  placement  appears  to  be  one  of  the  most 
troublesome  aspects  of  the  training  process  (see  E.  Anderson,  1980) . 
Yet  it  is  this  aspect  that  ultimately  determines  the  effectiveness  of 
the  program.  Unfortunately,  too  many  trainees  pursue  the  programs, 
graduate,  and  are  then  left  in  the  same  shape  they  were  in  before  they 
became  involved  in  the  program.  It  is  this  result  that  repeats  itself 
far  too  often,  lending  credence  to  negative  commentary  on  the  programs 
within  the  minority  communities.  The  comments  of  one  former  program 
participant  are  relevant: 

As  far  as  I  know,  no  one  [of  his  job-training  cohort]  got  a 
permanent  job.  Like,  I  got  a  job  for  a  year,  right?  What 
could  I  have  done?  That  was  money  I  made  and  spent  on  clothes, 
a  little  carfare.  You  couldn't  make  no  moves  [to  get  married, 
for  instance,  to  buy  an  automobile,  or  to  rent  an  apartment] 
with  it.  Now  with  my  program,  the  people  made  it  for 
themselves.  Now  the  director  of  my  program  went  on  to  a 
multimillion  dollar  insulation  program.  He  contracted  his  work 
out  of  Jersey,  New  York,  and  cities  in  this  area  here. 

Pittsburgh.  He  went  to  Reading,  little  cities  and  towns  in 
Pennsylvania,  Ohio,  Delaware.  But  he  did  not  take  none  of 
those  people  that  was  involved  in  his  program.  And  he  liked 
m el  But  he  never  invited  me  to  do  insulation  work.  Because  he 
most  likely  wasn't  confident  in  what  they  were  teaching  us. 

And  you  knew  it  wasn't  enough,  because  the  extent  of  the 
weather ization  program  we  went  to  was  plastering  holes,  putting 
on  the  heat  blanket,  Mortite,  caulking  a  window.  That  was  the 
extent  of  the  matter.  But  he  took  it  farther  than  that.  He 
insulated  all  the  pipes  of  people's  homes.  He  contracted  all 
the  work  in  all  these  new  buildings.  So  before  anybody  move 
into  these  houses  he  was  insulating  them. 

What  I'm  saying  is  that  the  whole  program  was  about  somebody 
taking  an  interest  in  hiring  these  young  people,  to  give  them 
permanent  jobs.  That  was  the  whole  thing.  That's  what  they 
were  asking  these  companies  to  do.  Yet  and  still  this  man  took 
on  a  multimillion  dollar  program  of  his  own.  He  started  it 
without  a  dime.  His  name  and  a  couple  of  his  references  got 
him  maybe  a  million  dollar  loan  from  a  bank  [the  accuracy  of 
this  figure  is  uncertain] .  But  he  did  not  take  no  one  with 
him.  He  took  one  of  the  instructors.  He  gave  another 
instructor  money  to  start  his  own  glass  block  company.  And 
these  are  now  reputable  companies.  You  look  in  the  white  pages 
or  the  yellow  pages,  and  you'll  see  these  companies. 
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Because  of  such  experiences ,  many  youths  approach  job-training  programs 
with  a  certain  generalized  suspicion  of  “programs. 99 

On  many  occasions,  the  program  “advertises99  itself  on  ghetto 
streets,  where  instructors  and  trainees,  perhaps  unwittingly,  are  at 
times  under  the  watchful  eyes  of  prospective  trainees.  Following  are 
some  comments  by  a  black  male,  21  years  old,  who  only  briefly 
considered  becoming  involved  as  a  job-training  participant: 

I  was  on  the  street  once  and  one  of  the  CETA  supervisors  sent 
one  of  the  guys  across  the  street  to  pick  up  some  material. 

And  because  the  store,  the  clerks,  did  not  wait  on  him 
promptly,  the  supervisor  came  across  the  street  and  hollers  at 
the  guy  like,  "What  the  hell  are  you  still  waiting  over  here 
f or? J  Get  yo*  ass  across  the  streets "  Now,  I'm  talking  about 
seeing  him  do  this  in  a  store  full  of  people,  you  know.  I 
mean,  the  guy  must've  felt  bad.  I  know  I  would've  felt  bad. 

And  then  the  supervisor,  after  that,  he  turned  around,  he 
laughed  about  it.  That  just  shows  you  how  they  treat  the 
workers. 

In  the  foregoing  incident  both  the  supervisor  and  the  trainee  were 
black  men,  an  indication  that  conflict  and  tension  between  supervisor 
and  trainee  are  not  simply  or  always  a  function  of  interracial 
relations  but  sometimes  a  function  of  hierarchy  and  the  promotion  of 
discipline  itself.  Yet,  importantly,  such  incidents  do  little  for  the 
community's  image  of  the  job-training  program. 

On  the  basis  of  such  treatment  by  instructors,  the  already 
suspicious  trainee  may  question  the  instructor's  ability  to  make  a 
commitment  to  teaching  him  anything.  But  trust  in  the  instructor's 
ability  is  essential  to  any  worthwhile  mentor-trainee  relationship. 
Hence,  the  relationship  between  the  ghetto  youth  and  the  instructor  is 
a  difficult  one  and  can  contribute  to  the  ineffectiveness  of  the 
general  program.  But  equally  important,  in  such  scenarios,  told  and 
repeated  in  the  ghetto  community,  "the  program"  is  made  to  seem 
increasingly  unattractive,  again  contributing  to  its  disvalued  status. 

Thus,  in  many  communities,  the  program  has  a  "bad  name,"  and  a 
reputation  for  being  "a  sham"  and  "a  waste  of  time,"  leading  many  to 
believe  that  participation  is  not  a  very  worthwhile  way  to  spend  one's 
time,  even  if  the  person  is  unemployed.  This  is  indicated  in  the 
following  interview  with  a  21-year -old  youth,  who  had  been  involved 
with  “the  program"  and  had  worked  in  a  related  job  for  a  year,  but  who 
felt  he  had  really  not  advanced  from  where  he  started: 

Boy,  these  programs  were  very  misleading,  'cause  they  were  very 
unsuccessful.  Led  the  people  to  believe  they  would  get 
permanent  jobs.  And  they  had  the  right  people  there.  They  had 
the  motivators.  They  had  the  people  there  who  talk  good 
[convincing],  the  cons,  and  all  that.  But  I  told  'em  when  they 
talked  to  me  like  that.  See,  I  don't  take  things  at  face 
value.  When  somebody  tell  me  "I  can  get  you  permanent  work,"  I 
want  them  to  take  it  into  parts.  Tell  me  why  you  think  that. 

Do  you  know  somebody  who's  gon '  give  me  permanent  work? 


360 


The  program  was  a  waste  of  money,  a  waste  of  time,  very 
misleading,  and  it  got  a  very  bad  rep  in  the  community.  They 
got  the  community  all  involved.  Now,  this  happened  in  '81  and 
9 83.  A  number  of  the  people  wouldn't  believe  in  it  from  the 
beginning.  And  the  ones  who  do  get  involved  will  be  involved 
only  for  the  money,  only  if  there's  a  salary  involved.  It's 
just  a  band-aid.  Everybody  lacks  confidence  in  it.  It  was  a 
political  act.  They  hired  all  these  young  guys  just  to  get 
them  off  the  street.  It  would  be  to  your  advantage  not  to  be 
involved.  Because  it  takes  up  time,  and  time  is  money.  You 
start  off  with  confidence,  but  down  the  line  you  gon '  be  let 
down.  I  don't  know  anyone  that  took  that  [was  involved  in  the 
program]  that's  now  independent.  If  they  were  on  welfare 
before  they  started  the  program,  they  got  back  on.  The  program 
is  just  a  sham.  It  was  just  a  political  move.  People  play in ' 
chess  with  other  peoples'  lives. 

That  general  population  toward  which  government-sponsored  employ¬ 
ment  programs  are  usually  geared,  the  hard-core  unemployed,  can 
generally  be  described  as  youths  whose  employment  prospects  are  quite 
limited  even  as  they  enter  high  school.  There,  decisions  are  made  tha 
affect  the  scheme  of  their  entire  lives.  The  tendency  is  for  the  youn 
black  man  from  the  inner  city  to  either  quit  or  socially  "graduate" 
from  a  segregated  urban  school  unable  to  read,  write,  or  compute. 

Given  the  large  amount  of  distrust  for  black  males  in  the  urban 
environment,  he  has  little  chance  for  permanent,  gainful  employment. 

Some  youths  may  become  involved  in  "dealing"  drugs,  which  can 
involve  anything  from  marijuana  to  heroin.  Today,  one  does  not  have  t 
be  a  full-time  "professional"  dealer  to  be  employed  in  the  drug 
business;  one  can  often  engage  in  this  criminal  activity  only  part 
time,  and  sometimes  for  as  little  as  a  $10  initial  investment.  Simple 
participation  is  often  contingent  upon  and  a  result  of  a  need  for 
money.  A  person  may  get  involved  in  the  illegal  selling  of  drugs  the 
way  a  gambler  would  bet  on  a  horse  or  play  a  slot  machine:  he  has 
money  for  the  moment  to  gamble  in  the  hope  of  a  quick  return;  he  may 
have  as  much  as  $10  or  $20  and  want  to  double  it.  He  buys  the  drugs 
wholesale,  carries  them  around,  and  attempts  to  sell  them.  Such 
behavior  is  in  reality  a  large  gamble.  If  he  "wins,"  he  earns  a 
profit;  if  he  loses,  he  could  wind  up  as  a  victim  of  violence  for 
selling  "bad"  drugs  or  for  being  part  of  a  misunderstood  deal,  or  as  a 
inmate  in  jail  if  he  tries  to  sell  to  the  wrong  person  and  is  found 
guilty  of  possession.  Although  he  may  venture  into  drug  dealing  on  a 
lark,  he  is  very  serious  about  his  need  for  money.  He  may  win  this 
time,  and  if  he  does,  he  is  back  into  circulation  for  a  while.  While 
pursuing  this  life-style,  he  continues  sporadically  to  look  out  for  a 
job.  When  he  sees  a  sign  in  a  window  for  "help  wanted,"  he's  uncertai 
that  the  sign  applies  to  him;  he  believes  he  will  be  turned  down.  He 
has  been  turned  down  so  often  he  expects  "no,"  even  though  he  may  have 
witnessed  the  sign  being  placed.  Prospective  employers  often  stereo¬ 
type,  distrust,  and  fear  him.  On  an  existential  and  experiential 


level,  he  knows  this  well.  With  a  series  of  such  experiences,  he 
becomes  frustrated  and  increasingly  discouraged. 

At  this  point  he  may  see  signs  on  bulletin  boards  at  the  community 
center  about  "job  training."  As  he  looks  into  this,  he  does  so  with 
some  suspicion,  for  he  personally  knows  few  people,  if  any,  who  have 
obtained  a  permanent  job  through  a  job-training  program.  Yet  with  few 
employment  options,  he  looks  into  the  job-training  program.  He  becomes 
involved,  hoping  to  gain  a  permanent,  well-paying  job.  But  he 
approaches  the  program  with  cautious  hope.  In  time,  he  comes  to  see 
that  marketable  skills  that  would  make  him  truly  competitive  in  the 
workplace  are  not  being  offered.  The  "skills"  that  are  being  offered, 
he  thinks,  one  should  not  have  to  spend  time  in  school  for.  For 
example,  after  being  promised  that  he  will  be  taught  carpentry,  he  is 
taught  to  caulk  windows  instead.  He  begins  to  believe  the  program  is  a 
sham,  a  waste  of  his  time.  He  begins  to  lose  interest,  yet  he  has  few 
employment  options  and  desperately  needs  money.  He  will  do  almost 
anything  at  this  point,  though  he  badly  wants  a  "good  job,"  preferring 
to  have  a  law-abiding  occupation.  Becoming  socially  involved  with  his 
fellow  trainees,  he  remains  with  the  program  for  two  or  three  months. 
Later,  he  "lucks  up"  on  a  job  caulking  windows  for  $3.50  an  hour  and 
remains  employed  for  a  year.  At  the  end  of  a  year,  he  realizes  that 
he's  getting  nowhere?  thinking  about  his  future  he  decides  to  join  the 
army.  He  attempts  to  enlist,  but  he  is  rejected  because  he  lacks  a 
high  school  diploma?  if  he  wants  to  enlist,  he  must  attend  night  school 
or  somehow  gain  a  General  Equivalency  Diploma. 

Among  some  youths  enlistment  in  the  military  is  a  matter  of  last 
resort.  The  following  comments  by  a  black,  22-year-old  Philadelphia 
taxicab  driver  are  relevanti 

I  was  involved  in  a  summer  jobs  program.  It  didn't  work  out. 

They  had  me  working  at  a  hospital.  But  the  people  didn't 
really  want  me  there.  I  was  there  for  a  couple  of  months,  and 
the  first  thing  I  know,  I  was  fired.  I  never  could  get  a 
reason  for  it.  They  wasn't  writing  me  up  or  nothing,  but  they 
did  complain  about  me,  little  petty  stuff.  I  got  on  [became 
employed]  with  the  cab  company  and  started  driving  a  cab.  What 
they  really  need  to  do  is  just  get  people  permanent  jobs.  .  .  . 

The  military  has  helped  a  couple  homies  [close  friends]  of 
mine.  But  I  wouldn't  go  in.  I  would  have  to  be  doin'  boss 
[very]  bad  to  do  somethin®  like  that. 

Unfortunately,  many  young  men  who  are  without  jobs  and  prospects 
strongly  feel  that  they  have  only  their  manhood  and  their  toughness, 
and  until  they  gain  something  better  they  will  try  to  retain  that.  In 
attempting  to  do  so,  they  often  find  a  certain  local  acclaim  and  self¬ 
esteem  among  peers  in  fathering  children  out  of  wedlock,  engaging  in 
petty  and  even  serious  street  crime,  selling  drugs,  or  burglarizing 
homes.  They  are  often  left  to  approach  "trouble"  for  personal  affirma¬ 
tion  and  gloat  or  brag  about  running  and  shooting  encounters  with  other 
young  men  or  the  police.  Their  resolution  of  a  dire  need  for  employment 
and  money  is  sometimes  to  involve  themselves  in  some  form  of  antisocial 
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behavior,  perhaps  winding  up  in  jail  or  in  the  military;  judges  have 
been  known  to  give  the  young  man  a  choice. 

In  addition  to  the  poor  reputation  youth  employment  programs  have 
acquired  in  minority  communities,  it  is  important  to  consider  the 
reputation  of  work  as  it  is  so  often  defined  and  emphasized  by  such 
programs.  So  often  the  jobs  for  which  youths  are  being  trained  are 
thought  of  as  dead  end  and  menial;  it  is  difficult  for  the  youth  to 
perceive  the  possibility  of  real  advancement  through  such  work.  The 
training  is  often  perceived  as  conferring  low  status  on  a  person,  who 
frequently  possesses  an  expanded  sense  of  racial  and  personal  pride 
(see  E.  Anderson,  1980)  .  This  again  raises  the  issue  of  "strain9'  or 
lack  of  social  "fit"  between  the  older  instructors  and  the  younger 
trainees.  The  instructors  in  the  program  share  certain  beliefs  and 
values  concerning  work,  work  settings,  propriety,  and  the  work  ethic. 
Many  profess  to  believe  in  "hard  work"  for  just  rewards.  This  is 
perhaps  an  outmoded  notion  in  our  contemporary  society,  especially 
among  many  ghetto  youths  who  are  mobile  about  town  and  are  readily  abl 
to  view  others  of  their  color -caste  riding  trolleys,  trains,  and  buses 
and  dressed  in  pinstriped  suits  and  carrying  briefcases.  They  have 
come  to  see  this  model,  to  wonder  about  him,  and  perhaps  to  desire  to 
emulate  him. 

Yet  these  youths  have  little  real  chance  of  moving  toward  being 
that  sort  of  man,  the  young  professional,  if  they  are  being  trained  to 
be  a  carpenter,  and  poorly  at  that.  Common  sense  tells  them  that  such 
jobs  are  closed  to  them  and  their  kind;  from  their  elders,  they've 
heard  the  tales  of  discrimination,  and  many  have  experienced  it  first¬ 
hand.  Hence,  many  youths  approach  the  program  with  a  limited  amount  o 
motivation.  Many  are  ambivalent  about  the  value  of  such  a  program, 
even  if  they  were  to  be  successful  in  completing  it.  For  ultimately, 
the  program  prepares  the  young  people  for  jobs  many  have  come  to  see  a 
"beneath"  them,  and  hence,  the  more  they  invest  in  terms  of  time  and 
energy,  the  more  they  believe  they  condone  what  is  in  their  estimation 
an  essentially  inferior  social  and  economic  position,  not  to  mention 
the  boredom  and  toil  that  come  with  it.  Yet  they  want  jobs  badly. 

Many  older  black  workers,  including  laborers,  masons,  and 
plasterers,  say  that  today's  youth  won't  work.  Perhaps,  youths  are 
growing  up  in  a  society  in  which  physical  work,  in  its  strict 
working-class  definition,  is  simply  declining  as  a  value.  Having  a  jo 
is  surely  important,  but  valued  activities  are  often  those  that  can  be 
done  in  a  suit  and  tie,  not  a  pair  of  coveralls.  The  very  place  of  th 
term  "working  class"  in  our  lexicon,  a  place  below  all  other  classes 
save  the  very  poor,  is  a  clue  to  and  passes  along  society's  valuation 
of  the  place  of  "workers." 

Many  of  today's  youths  who  do  not  want  to  work  may  be  seen  less  as 
disconnected  from  society's  values  than  as  sharing  the  valuation  a 
great  many  people  place  on  physical  labor;  these  youths  are  very  much 
up-to-date  and  very  much  connected.  With  their  high  aspirations  and 
intermittent,  often  unrealistic,  expectations,  they  are  simply  under- 
educated,  untrained,  and  lacking  in  the  nonphysical  skills  necessary 
for  entry  into  labor  markets  with  jobs  for  professionals.  In  a  sense, 
minority  youths  are  held  accountable  to  values  of  physical  work  that 


seem  in  decline  in  the  face  of  increasing  automation  and  technology 
change  (see  Wilson,  1980;  Hershberg,  1981;  and  B.  Anderson,  1981) . 


SUMMARY  AND  CONCLUSIONS 

The  foregoing  account  illustrates  how  the  earlier  ethnic  experience 
was  very  different  from  that  of  blacks  and  other  colored  minorities 
today.  The  job  market  was  much  more  receptive  to  the  ethnic  whites, 
who  had  common  skin  color  and  a  certain  compatibility  with  the  system 
of  work.  This  general  receptivity  inspired  many  to  be  highly 
motivated.  Discrimination  did  not  exist  to  the  degree  that  it  now  does 
for  blacks  and  other  colored  people.  Family  and  friends  were  often 
supportive,  on  and  off  the  job.  These  primary  reference  groups  helped 
them  to  "work  out,"  in  part  because  they  were  representing  people  who 
had  helped  them  find  work  through  word  of  mouth,  but  also  because  they 
could  often  identify  with  those  they  were  joining  in  the  workplace  (see 
Shibutani,  1955).  Given  the  need  for  labor,  there  was  on-the-job 
training  for  those  who  had  no  skills. 

Strikingly,  this  supportive  environment  does  not  exist  for  minority 
youths.  Individuals — black  or  white — do  not  go  out  of  their  way  to 
help  such  youths.  Equally  important,  minority  youths,  beaten  down  by 
the  specter  of  distrust  and  discrimination,  are  often  resigned  to  their 
position.  And  because  of  this,  many  are  unwilling  or  unable  to 
recognize  and  seize  opportunity.  From  both  sides — instructors  and 
trainees — there  seems  to  be  a  profound  lack  of  confidence  in  the 
ability  of  the  trainees  to  make  progress  in  the  job  market.  Many  who 
would  employ  black  youths  share  this  lack  of  confidence  and  often  a 
prejudice  that  the  hard-core  unemployed  and  their  culture  are  truly  not 
compatible  with  the  work  setting.  Such  attitudes  represent  major 
obstacles  to  the  employment  of  youths  after  they  have  completed  job 
training  and,  thus,  are  important  considerations  for  the  effectiveness 
of  training  programs. 

The  trickling  out  of  talented  instructors  is  another  critical 
factor  affecting  the  effectiveness  of  employment  programs.  Since 
national  and  local  politics  often  play  such  an  important  role  in  the 
employment  programs,  funding  is  variable  and  at  times  unpredictable. 

As  the  programs  receive  decreasing  or  fluctuating  funding,  they  become 
increasingly  unable  to  attract  and  retain  effective  teachers  who  are 
likely  to  place  their  students  in  permanent  and  well-paying  jobs.  As 
the  teacher's  salary  becomes  uncertain  or  declines,  he  or  she  may  lose 
a  sense  of  commitment  to  the  program.  The  better  instructors  may  seek 
better-paying  jobs,  often  in  the  private  sector,  or  they  may  retire. 

Such  people  are  important  resources  for  the  programs,  in  part  because 
of  their  work  skills  and  their  teaching  abilities,  but  also  because  of 
their  connections  with  the  private  sector  and  their  interests  in  placing 
their  more  able  students.  In  the  early  days,  it  was  just  such  types  of 
individuals  who  served  ethnic  whites  as  effective  links  between  voca¬ 
tional  schools  and  the  work  setting.  But  these  people  are  rare  today, 
given  the  low  salaries  of  instructors  and  job  insecurity.  Their  absence 
bodes  ill  for  the  effectiveness  of  employment  training  programs. 
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Increasingly,  attempts  are  made  to  replace  such  people  with  their 
aides,  who  now  begin  to  teach,  but  who  are  not  as  highly  qualified  as 
their  former  teachers.  Equally  important,  they  sorely  lack  their 
teachers'  credibility  and  connections  with  the  workplace.  If  former 
aides  possessed  such  connections,  it  may  be  argued,  they  might  take 
advantage  of  them  for  themselves . 

Participants  in  the  programs  at  all  levels  often  feel  a  high  degr 
of  uncertainty  about  the  program's  immediate  future.  Social  and 
cultural  tensions  between  many  trainees  and  their  instructors  have 
perhaps  increased.  Yet  the  primary  issue  concerning  the  programs  stei 
from  the  inability  of  the  programs  to  place  participants  in  gainful 
occupations.  The  largest  complaint  among  black  youths  seems  to  be  th. 
the  programs  fail  to  deliver  permanent  jobs.  More  attention  must  be 
given  to  this  critical  issue.  It  is  chiefly  because  of  this 
failure — and  perceptions  of  it — that  relatively  few  trainees  have 
positive  evaluations  of  the  programs.  When  the  trainees  obtain  jobs, 
they  often  feel  they  could  have  obtained  the  job  without  having  gone 
through  the  program. 

Some  mechanism  must  be  instituted  for  accountability  in  the 
training  program.  To  be  effective,  programs  must  be  result  oriented. 
After  training,  participants  must  be  placed  in  gainful,  rewarding 
occupations.  A  novel  but  perhaps  very  effective  solution  to  the 
problem  of  placement  may  be  a  guarantee  of  a  job  to  each  trainee  who 
successfully  completes  the  program.  Such  jobs  would  be  preferably 
those  in  which  the  person  could  clearly  expect  a  degree  of  financial 
security  or  mobility  for  his  honest  and  diligent  efforts.  In  this 
effort  to  solve  what  is  too  easily  viewed  by  many  as  an  intractable 
social  problem,  the  private  sector  must  become  much  more  deeply 
involved.  Along  with  the  federal  government,  corporate  America  must 
play  a  more  direct  and  important  role  in  the  training  and  placement  o 
young  people.  Training  programs  must  be  made  to  work.  When  trainees 
are  well  trained  and  systematically  and  effectively  placed  in  gainful 
employment  situations,  they  will  declare  the  program  effective  and 
successful.  Then  young  unemployed  people  will  be  standing  in  line  to 
enroll  in  job-training  programs  instead  of  having  to  be  recruited  as 
they  are  now. 
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Youth  Joblessness  and  Race: 
Evidence  from  the  1980  Census 

George  Cave 


In  1983  the  Census  Bureau  released  microdata  based  on  the  "long- 
form"  questionnaire  completed  by  about  one-fifth  of  the  respondents  in 
the  1980  Census.  "Public-Use  Microdata  Sample  C"  identifies  the  "type 
of  area" — central  city,  urban  fringe,  rural,  and  so  on — for  a  full  1 
percent  of  the  U.S.  population  (Bureau  of  the  Census,  1983) .  The  large 
size  of  this  data  set  enables  researchers  to  study  the  impact  of  area 
type  and  many  other  factors  on  a  multitude  of  individual  variables 
measured  by  the  questionnaire.  In  addition  to  the  1  percent  population 
sample,  a  0.1  percent  subsample  provides  data  on  226,947  individuals 
surveyed  in  the  1980  Census. 

This  paper  compares  the  data  on  unemployment  and  other  labor  force 
behavior  reported  for  black  youths  with  that  reported  for  white  youths. 
The  key  question  addressed  is.  Do  black  youths  face  special  problems  in 
the  labor  market  due  to  their  race?  A  related  question  is  whether 
correcting  black  and  white  youth  labor  force  statistics  for  location, 
education,  family  income,  and  other  factors  tends  to  eliminate  the 
racial  differences.  This  paper,  like  most  others  in  the  empirical 
literature  on  youth  unemployment,  uses  simple  single-equation  methods 
to  correct  for  these  factors.  However,  the  results  must  be  interpreted 
very  carefully  for  several  reasons.  First,  most  coefficients  estimated 
on  data  for  individuals  are  subject  to  "ecological  correlation  bias"  if 
the  labor  market  characteristics  of  the  respondents'  local  areas  are 
missing  from  the  data  set.  Second,  the  most  common  single-equation  or 
system  methods  may  not  estimate  structural  coefficients  for  individuals' 
and  employers'  behavior.  Third,  single-equation  methods  introduce 
simultaneity  bias  if,  for  example,  the  probability  of  unemployment 
influences  the  probability  of  labor  force  participation.  Finally,  even 
system  methods  may  ignore  some  simultaneity  and  overcorrect  for  factors 
other  than  race.  To  some  extent,  residential  location  within  the  local 
labor  market,  quantity  and  quality  of  education,  family  income,  and  so 
on  are,  like  unemployment,  partly  the  consequences  of  race  in  the  labor 
market.  To  ignore  the  effect  of  race  on  these  determinants  of  labor 


George  Cave  is  on  the  staff  of  the  Manpower  Demonstration  Research 
Corporation. 


368 


force  status  is  to  ignore  the  indirect  labor  market  effects  of  race  or 
unemployment . 

This  paper  is  organized  as  follows.  First,  the  data  sets  and  the 
statistical  methods  used  most  extensively  in  this  study  are  described. 
Next,  a  brief  overview  is  given  of  the  seasonal,  cyclical,  frictional, 
and  structural  components  that  complicate  empirical  analysis  of  the 
youth  unemployment  problem.  This  section  also  includes  a  survey  of 
several  earlier  empirical  analyses.  The  empirical  analysis  of  the 
labor  force  status  of  out-of-school  black  and  white  teenagers  included 
in  the  Census  microdata  follows.  Then  the  very  different  behavior  of 
those  teenagers  who  were  enrolled  in  school  at  any  time  during  the  twc 
months  before  Census  day  is  explored.  The  paper  ends  with  a  summary  c 
the  major  findings. 


THE  DATA 

The  0.1  percent  subsample  of  "Public-Use  Microdata  Sample  C"  has 
226,947  self-weighting  observations  on  individuals.  Of  these,  8,653 
are  young  men  aged  16-19.  Because  only  1,190  of  these  young  men  are 
black,  stratifying  the  sample  by  region,  education,  and  other  factors 
produces  some  data  cells  with  no  nonwhites.  The  problem  becomes  even 
more  severe  when  students  are  excluded  from  this  group;  there  remain 
2,061  white  males,  but  only  372  black  males.  Fortunately,  it  is  easy 
to  increase  the  number  of  nonwhites  by  a  factor  of  10  by  using  the  ful 
1  percent  sample  of  nonwhites.  However,  calculations  based  on 
stratified  samples  containing  nonwhites  from  the  full  C  sample  but  on] 
those  whites  in  the  0.1  percent  subsample  require  special  techniques. 
Heteroscedasticity  could  arise  from  the  10-fold  greater  chance  a 
nonwhite  respondent  had  to  get  into  such  stratified  samples.  Still, 
the  huge  Census  microdata  samples  enable  appropriately  cautious 
researchers  to  home  in  on  interesting  subgroups  in  ways  that  smaller 
samples  do  not  permit. 

The  main  dependent  variables  used  here  reflect  labor  force  status 
during  the  week  of  the  Census  survey.1  Unfortunately,  questions  that 
would  have  identified  "discouraged"  workers  during  the  survey  week  wei 
not  asked.  However,  analyzing  nonstudents  separately  picks  up  some 
part  of  the  often-neglected  behavior  of  those  who  are  not  in  school  ye 
are  neither  employed  nor  unemployed. 


^his  measure  of  labor  force  behavior  is  the  most  common.  Alter¬ 
natives  are  available;  the  number  of  weeks  spent  in  unemployment  and  j 
employment  in  1979  are  recorded  for  everyone  16  years  and  older  in 
"Public  Use  Microdata  Sample  C."  Survey-week  labor  force  behavior  is 
related  systematically  to  weeks  and  spells  of  unemployment  over  the 
course  of  a  year;  see  Betsey  (1978)  and  Hanoch  (1976).  Using  survey- 
week  behavior  does  not  distinguish  between  the  short-term  and  long-tei 
unemployed. 
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Other  variables  available  for  all  respondents  include  census  region, 
type  of  area,  householder  status,  age,  race,  marital  status,  disabil¬ 
ities,  years  of  school  completed,  whether  the  respondent  has  ever 
worked,  and  income  status.  For  those  with  at  least  some  employment  in 
1979,  earnings,  usual  weekly  hours,  and  industry  in  which  employed  are 
also  available.  Unfortunately,  crucial  variables  that  are  not  available 
include  actual  hourly  wages,  the  number  of  spells  of  unemployment  in 
1979,  the  number  of  job  offers  refused  during  job  search,  and  eligibil¬ 
ity  for  unemployment  compensation. 


METHODOLOGY 

Two  basic  methods  are  used  in  this  analysis  to  compare  black  and 
white  labor  force  behavior.  Both  attempt  to  explain  dummy  variables 
for  employment,  unemployment,  and  nonparticipation.  When  black  and 
white  samples  are  combined,  and  when  race  is  one  of  the  independent 
variables,  the  coefficient  of  race  shows  the  increase  in  the 
probability  of  the  behavior,  conditional  on  the  other  independent 
variables,  that  can  be  attributed  to  being  black.  As  in  Freeman 
(1982) ,  linear  probability  models  (LPMs)  are  estimated  because  they 
explain  quite  simply  some  important  relationships  among  the  three 
dependent  variables.  However,  because  of  well-known  econometric 
difficulties  with  linear  probabilities,  logistic  methods  are  used  as 
well.2 

Using  both  methods,  linear  and  logistic,  equations  are  estimated 
for  two  types  of  dependent  variables,  unconditional  and  conditional. 
Unemployment  and  employment  equations  are  estimated  both  for  the  entire 
population  and  for  labor  force  participants  only.  In  these  models,  the 
coefficients  for  conditional  employment  and  unemployment  have  the  same 
magnitude,  but  different  signs.  The  next  section  points  out  structural 
interpretations  for  the  conditional  equations;  these  reflect  employer 
behavior  and  make  the  unconditional  equations  reduced  forms  confounding 
employer  and  individual  structural  coefficients. 


OVERVIEW  OF  THE  YOUTH  UNEMPLOYMENT  PROBLEM 

The  Many  Faces  of  Unemployment 

Even  though  economists  have  produced  a  large  literature  on 
unemployment  and  take  many  separate  approaches  to  the  subject,3  not 


2See  Nerlove  and  Press  (1973:Ch.  2).  The  LPM  predicts  probabilities 
outside  the  unit  interval,  is  subject  to  heteroscedasticity ,  and  in 
general  does  not  fit  the  statistical  assumptions  underlying  least 
squares  regression. 

3 Two  important  strands  of  this  literature  are  largely  theoretical: 
macroeconomic  general  equilibrium  and  wage-search  distributions.  Hey 
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much  fundamental  progress  has  been  made  in  explaining  unemployment, 
adequate  economic  explanation  of  unemployment  would  separate  relevant 
factors  reflecting  the  preferences  of  individuals  for  consumption  of 
goods  and  uses  of  time  from  factors  constraining  individuals1  choices 
about  consumption  and  work.  Moreover,  such  an  explanation  would 
systematize  many  of  the  stylized  facts  about  unemployment.  Further, 
such  an  explanation  would  yield  empirically  testable  hypotheses  for 
existing  data  about  unemployment. 

One  problem  is  that  the  same  word,  unemployment,  is  used  to  denot 
many  very  different  phenomena.  For  a  long  time,  empirical  work  on 
unemployment  among  individuals  has  tried  to  classify  such  unemploymen 
as  "seasonal,"  "cyclical,"  "frictional,"  or  "structural,"  although  it 
has  been  recognized  that  a  given  spell  of  unemployment  for  a  given 
individual  might  be  very  difficult  to  categorize. 


Seasonal  and  Cyclical  Unemployment 

One  sort  of  seasonal  unemployment  is  a  characteristic  of  certain 
occupations,  such  as  construction  work.  Workers  committed  to  such 
occupations  generally  do  not  take  other  kinds  of  jobs  during  the 
off-season,  perhaps  because  their  wages  reflect  compensating  differ¬ 
entials  for  the  known  risk  of  unemployment  at  certain  times  of  the 
year.  This  sort  of  demand-side  unemployment  is  unlikely  to  affect 
young  people,  who  generally  have  not  yet  committed  themselves  to 
occupations. 

The  failure  of  schools  and  colleges  to  stagger  their  vacation 
periods  produces  another  kind  of  seasonal  unemployment,1*  which  can  be 
attributed  to  the  supply  side  of  the  youth  labor  market.  A  deluge  of 
young  people  compete  for  relatively  few  jobs  each  summer.  If  the  kin 
of  jobs  young  people  take  during  their  summer  vacations  paid  lower 
wages,  some  have  argued,5  the  problem  would  be  smaller. 

Cyclical  unemployment  occurs  less  predictably  and  is  tied  to  the 
business  cycle  and  to  cycles  of  product  demand  within  industries. 
There  has  been  a  great  deal  of  recent  work  on  the  nature  of  long-term 
contracts  between  firms  and  workers  who  are  periodically  laid  off 
temporarily  and  then  rehired.  Feldstein  (1976)  estimated  that  75 


(1981)  provides  a  survey.  Some  important  articles  in  the  empirical 
literature  are  cited  in  the  next  section. 

‘‘However,  Clark  and  Summers  (1982:209)  cite  gross  flow  evidence  that 
demand  for  young  workers,  on  the  whole,  adjusted  remarkably  well  to 
increased  supply  during  the  summer  over  the  years  1968-1976.  They 
surmise  from  preliminary  statistical  work  that  federal  Neighborhood 
Youth  Corps  and  CETA  programs  may  explain  their  surprising  findings  o 
this  point. 


5See  Brown  (1981)  for  a  survey  of  many  of  the  issues  surrounding 
minimum  wage  differentials  for  youth. 


percent  of  laid-off  workers  in  manufacturing  subsequently  are  rehired 
by  the  same  employer.  He  cited  1975  evidence  that  41  percent  of 
unemployed  men  aged  25-64  who  had  been  laid  off  had  made  no  attempt  to 
find  jobs  during  the  previous  month.  However,  since  young  people  tend 
not  to  have  made  solid  commitments  to  particular  firms  or  even  to 
particular  industries,  temporary-layoff  theories  are  less-convincing 

explanations  for  their  unemployment  than  for  the  unemployment  of  older 
workers. 

The  next  subsection  provides  rough  evidence  that  even  cyclical 
unemployment  tied  to  the  business  cycle  is  less  important  for  younger 
people  than  for  more-established  workers.  This  lack  of  cyclical 
sensitivity  is  reassuring,  since  elsewhere  in  the  paper  I  focus  on 
cross-sectional  data  pertaining  only  to  March  1980  and  calendar  1979. 


Cyclical  Sensitivity  of  Youth  Unemployment 

Because  I  talk  about  a  single  cross-section  of  individuals  in  the 
remainder  of  the  paper,  I  do  not  have  much  to  say  about  cyclical 
influences  on  youth  unemployment.  How  important  are  they? 

Persistent  unemployment  of  at  least  3.5  percent  (measured  as  annual 
averages  of  monthly  Current  Population  Survey  estimates)  has  afflicted 
the  U.S.  civilian  labor  force  since  the  mid-1950s.  The  aggregate  rate 
fell  from  5.5  percent  in  1954  to  4.1  percent  in  1956.  Then  it  jumped 
to  6.8  percent  with  the  1958  recession.  It  fell  again  to  5.5  percent 
in  1959  and  1960  and  then  rose  abruptly  to  6.7  percent  for  1961.  With 
the  exception  of  a  slight  faltering  in  1963,  it  fell  steadily  from  its 
1961  level  until  it  reached  the  post-1953  trough  of  3.5  percent  in 
1969,  a  war  year.  Since  then,  as  Table  1  shows,  it  rose  in  1970  and 
1971,  fell  in  1972  and  1973,  rose  through  1975  to  a  three-decade  peak, 
and  fell  to  the  1979  low  preceding  the  most  recent  recession. 

Although  the  aggregate  time  series  is  sensitive  enough  to  reveal 
broad  trends,  it  masks  a  great  deal  of  the  labor  market  behavior  that 
disaggregation  reveals.  In  addition  to  aggregate  unemployment  rates. 
Table  1  shows  unemployment  rates  for  certain  sex,  age,  and  race  groups, 
including  groups  of  teenagers  16-19  years  old.  With  the  exception  that 
teenage  unemployment  was  below  12  percent  for  the  three  years  preceding 
1958,  1969  was  the  post-1953  trough  for  each  of  the  disaggregated 
series  as  well  as  for  the  aggregate  unemployment  rate.  But  many  of  the 
disaggregated  series  have  kept  the  same  rank  relative  to  each  other 
ever  since  1950.  Moreover,  some  of  the  series  are  much  more  stable 
over  time  than  others. 

Table  1  shows  coefficients  of  variation  (ratios  of  standard 
deviations  to  means)  for  the  aggregate  series  and  for  20  disaggregated 
groups  for  the  period  between  1972  and  1982.  It  also  shows  the  rank  of 
each  coefficient  of  variation  (c.v.)  among  the  21  coefficients 
reported.  The  aggregate  series  ranks  14th  at  21.09  percent.  All  7 
groups  of  teenagers  rank  above  the  aggregate  series?  in  fact,  the 
teenage  groups  account  for  4  of  the  top  4  groups  and  7  of  the  top  11 
groups.  The  coefficient  for  the  top  group,  black  women  aged  16-19,  is 
barely  a  third  of  the  aggregate  coefficient.  At  the  other  end  of  the 
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scale,  groups  containing  older  men  account  for  all  of  the  bottom  six 
ranks.  Older  women  tend  to  rank  just  below  the  groups  of  teenagers. 
Thus,  from  a  disaggregation  of  time  series  using  coefficients  of 
variation  to  index  instability,  it  can  be  seen  that  older  men's 
unemployment  is  most  susceptible  to  macroeconomic  forces  exerted  on  all 
demographic  groups  over  time,  while  teenage  unemployment  is  influenced 
least  by  such  forces. 


Frictional  Wage-Search  Unemployment 

Frictional  wage-search  unemployment  results  from  the  dynamics  of 
labor  markets.  People  move  in  and  out  of  the  labor  market  as  they  age, 
e  as  their  skills  change,  as  wage  levels  rise  and  fall,  and  as  family 
needs  and  financial  fortunes  vary.6  Jobs  are  created  as  firms  are 
established,  as  plants  are  opened  in  new  areas,  and  as  older  workers 
are  forced  to  retire.7  But  it  may  take  a  few  weeks  for  would-be 
workers  and  firms  with  vacancies  to  search  out  and  find  each  other.  A 
job  applicant  might  not  take  the  first  offer  of  wages  and  working 
conditions,  and  a  firm  might  not  be  willing  to  meet  the  first  appli¬ 
cant's  wage  bid.  Such  "search"  unemployment  might  affect  young  people 
disproportionately  more  than  adults,8  because  they  are  making  gradual 
transitions  from  full-time  schooling  to  full-time  labor  force  partici¬ 
pation.  Young  people  experiment  with  industries  and  occupations  before 
making  lifetime  commitments.  Sometimes  they  have  parents  to  support 
extended  periods  away  from  both  school  and  the  labor  force,  and  some¬ 
times  they  might  misreport  such  nonparticipation  as  unemployment. 

According  to  "search  theories"  of  frictional  unemployment,9 
heterogeneity  among  individuals  and  among  firms  leads  firms  to  search 
for  workers  and  individuals  to  search  for  vacancies.  The  latter  type 
of  search  has  virtually  been  identified  with  unemployment  by  many  labor 
economists,  usually  under  the  restrictive  assumption  that  the  utility 
function  governing  individual  behavior  is  defined  over  discounted 
future  wages,  net  of  search  costs  but  ignoring  foregone  leisure. 


6When  movement  into  the  labor  force  exceeds  steady  state  levels, 
structural  unemployment  may  arise  in  addition  to  frictional 
unemployment.  It  may  take  some  time  for  employers  to  adjust  their 
hiring  and  wage  policies  to  the  increased  supply  of  potential 
employees . 

destruction  of  jobs  by  the  same  kinds  of  processes  may  lead  to 
structural  unemployment  for  established  workers  at  the  same  time  that 
it  creates  frictional  unemployment  for  new  entrants  into  the  same  or 
another  job  market. 

8 But  see  note  15  below. 

9See  Hey  (1981:Ch.  5)  for  an  accessible  survey  of  this  literature. 
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According  to  these  theories,  every  worker  is  unemployed  because  he 
turns  down  all  proffered  vacancies  until  he  has  been  offered  his 
acceptance  wage.  The  acceptance  wage  is  the  wage  such  that  there  is  no 
marginal  gain  in  expected  utility  from  continuing  to  search.  Though 
firms  search  for  workers,  if  only  in  the  sense  that  they  do  not 
necessarily  hire  the  first  applicant  for  a  given  vacancy,  most  search 
theories  tend  to  ignore  this  phenomenon  and  attribute  unemployment 
solely  to  workers'  searching  for  firms.  The  testable  assertion  here — 
that  the  unemployed  have  refused  actual  job  offers — has  not  been  pitted 
against  empirical  evidence  very  often.  But  when  it  has  been  tested, 
the  idea  that  most  of  the  unemployed  have  refused  wage  offers  has  not 
fared  well. 1 0 


Structural  Unemployment 

In  contrast  to  voluntary,  frictional  unemployment  is  the  notion  of 
involuntary,  structural  unemployment,  which  is  defined  by  Killingsworth 
(1978:22)  as  "joblessness — usually  long-term — which  results  from  basic 
changes  in  the  economic  structure:  new  technology,  the  decline  of  some 
industries  and  the  growth  of  new  ones,  geographic  relocation  of 
industries,  permanent  changes  in  consumer  tastes,  changes  in  labor 
force  characteristics,  and  so  on."11 

For  unskilled  workers,  among  whom  are  most  young  people,  legal 
minimum  wages  or  high  union  wage  scales  may  be  an  important  barrier  to 


10For  example,  Rosenfeld  (1977)  has  reported  empirical  work  on  the 
3,238  out  of  4,668  unemployed  in  the  May  1976  CPS  who  answered 
supplementary  questions  on  their  job-search  behavior.  The  high 
nonresponse  rate  and  low  potential  for  disaggregation  indicate  a  need 
for  more  special  surveys  of  this  kind.  Yet  the  implications  of  the 
respondents'  answers  for  the  validity  of  search  unemployment  theories 
seem  clear.  Since  only  32  percent  were  on  layoff,  and  more  than  81 
percent  of  laid-off  workers  reported  some  effort  to  find  an  interim 
job,  only  6  percent  of  the  unemployment  could  have  been  seasonal  or 
cyclical  in  the  sense  used  in  this  paper.  Search  unemployment  due  to 
high  acceptance  wages  seemed  less  than  universal:  22  percent  stated 
willingness  to  accept  jobs  paying  less  than  the  federal  minimum  wage, 
then  $2.30  per  hour;  another  33  percent  were  willing  to  take  a  wage 
between  the  minimum  and  $2.99;  and  only  22  percent  reported  an 
acceptance  wage  of  $4.00  or  more.  Finally,  only  10  percent  of  those 
who  were  unemployed  four  weeks  or  more  and  who  had  contacted  at  least 
one  employer  reported  having  refused  any  job  offers. 

1 killingsworth  (1978)  recently  retold  the  postwar  history  of  this 
old  idea. 
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employment.12  In  an  important  theoretical  paper,  Weiss  (1980)  shows 
that  even  in  the  absence  of  legal  minimum  wages  or  union  pay  scales, 
firms  may  find  it  optimal  to  set  wages  fairly  high  and  to  refuse  to 
employ  members  of  certain  demographic  groups,  even  though  they  are 
willing  to  work  for  lower  wages. 

At  the  risk  of  excluding  some  dislocated  workers  from  the 
definition,13  the  structurally  unemployed  may  be  thought  of  as  those 
who  have  searched  for  jobs  but  found  no  employers  willing  to  hire 
them.  This  simple  definition  maximizes  the  contrast  between  frictional 
unemployment  and  structural  unemployment,  while  remaining  consistent 
with  neoclassical  labor  economics.  The  frictionally  unemployed  will 
join  the  ranks  of  the  employed  as  soon  as  they  lower  their  acceptance 
wages.  But  lowering  their  acceptance  wages  will  not  help  the  struc¬ 
turally  unemployed  find  work;14  they  have  not  refused  any  wage  offers. 

There  is  some  empirical  evidence  that  the  notion  that  the 
unemployed  are  refusing  wage  offers  is  especially  inappropriate  for 
young  men.15  If  this  is  true,  then  empirical  models  of  search 


12See  Demsetz  (1961) .  But  a  legal  minimum  wage  or  union  wage  scale 
need  not  be  binding  constraints  on  employer  behavior  if  there  are 
other,  higher,  wage  rigidities. 

13Lucas  (1978)  seems  to.  We  might  conceivably  argue  that  the 
laid-off  skilled  steelworker  in  Pittsburgh  who  won’t  sell  his  house  and 
take  a  minimum-wage  job  is  voluntarily  unemployed,  but  we  cannot  argue 
as  easily  that  an  unskilled  teenager  who  cannot  get  that  same  job  is 
unemployed  voluntarily. 

14 Indeed,  in  Weiss's  (1980)  model  it  is  precisely  the  positive 
relationship  between  the  acceptance  wage  and  expected  productivity  that 
causes  the  unemployment  of  workers  with  low  acceptance  wages.  Compare 
Lucas  (1978:354):  "The  unemployed  worker  at  any  time  can  always  find 
some  job  at  once.  .  .  .  However  miserable  one's  current  work  options, 
one  can  always  choose  to  accept  them." 

1 5Stephenson  (1976)  analyzed  281  respondents  of  the  300  unemployed 
males  aged  18-21  with  8-12  years  of  education  who  sought  full-time  jobs 
in  November  1971  at  the  Indianapolis  state  employment  service  office. 

He  states  (on  p.  110) :  "Nearly  90  percent  of  both  white  and  black 
youths,  when  describing  the  search  before  their  last  job,  said  they 
took  their  first  offer.  In  contrast  to  the  search  literature  which 
usually  implies  a  choice  among  several  offers,  the  central  search 
problem  of  young  men  may  be  to  find  a  single  offer."  Cave  (1983) 
exploits  this  insight  in  modeling  unemployment  among  unskilled 
workers.  Of  course,  because  of  its  self-selection,  Stephenson's  sample 
may  not  be  representative  of  all  unemployed  youth  in  Indianapolis  at 


376 


unemployment16  may  not  be  appropriate  for  individual  data  on  youth 
unemployment.  Alternative  models  directly  analogous  to  those  used  oi 
aggregate  data17  are  proposed  at  the  end  of  the  next  subsection. 


Implications  for  Empirical  Work  on  Youth  Unemployment 

Young  people's  behavior  in  labor  markets  is  even  more  complex  the 
the  behavior  of  their  elders.  Unlike  prime-age  males,  young  people 
have  nonparticipation  as  a  real  option,  and  they  exercise  it  often. 
Whether  they  are  in  or  out  of  the  labor  market,  they  must  make  anoth< 
constrained  choice  their  elders  rarely  face — whether  to  stay  enrollec 
in  school.  Moreover,  they  work  part-time  rather  than  full-time  more 
often  than  older  people  do.  Empirical  studies  of  youth  labor  markets 
must  deal  in  some  fashion  with  the  joint  determination  of  school 
enrollment,  military  status,  labor  force  participation,  hours  worked 
per  week,  and  wages.  There  is  important  simultaneity  between  par¬ 
ticipation  and  the  chance  of  unemployment  if  participation  is  chosen 
There  is  also  simultaneity  between  the  number  of  years  of  education  < 
person  has  and  the  chance  he  or  she  will  find  a  place  in  the  labor 
force . 

In  addition  to  the  simultaneity  problems,  there  are  problems  of 
definition  for  the  labor  force  variables.  Several  very  different  kir 
of  behavior  are  reported  as  the  same  empirical  phenomenon,  "youth 
unemployment."  For  someone  who  has  quit  school  permanently  and  who 
cannot  rely  on  family  financial  support,  reported  unemployment  may 
reflect  a  chronic  inability  to  find  any  hours  of  employment  at  any  wc 
level.  This  kind  of  involuntary,  structural  unemployment  may 
constitute  what  Conant  (1961)  called  "social  dynamite,"  and  it  has 
grave  implications  for  adult  poverty  and  crime.18  At  the  other  end 
of  the  spectrum  of  interpretations  of  these  statistics,  reported 
unemployment  in  a  particular  week  may  reflect  brief  job  search  or 
normal  experimentation  with  possible  careers.  For  someone  who  has 


16Since  the  search  literature  is  mainly  theoretical,  there  are  few 
empirical  search  models  to  criticize.  Kiefer  and  Neumann  (1979,  198: 
are  careful  to  use  data  on  permanently  laid-off  men  for  whom  their 
sophisticated  search  model  seems  especially  appropriate. 

1 7For  example,  Fleisher  and  Rhodes  (1976). 

1 ®Recent  empirical  work,  though  not  conclusive  because  of  poor  data, 
tends  to  make  Conant' s  fears  seem  ill-founded.  Freeman  and  Wise  (19 J 
briefly  survey  work  that,  based  on  longitudinal  data,  finds  no 
significant  effect  of  employment  history  per  se_  on  later  labor  force 
behavior,  once  persistent  individual  skill  and  motivation  difference; 
have  been  controlled  for.  But  Cave  (1981)  and  Levy  (1982)  criticize 
these  results  as  possibly  reflecting  unavoidable  selection  bias  agaii 
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ompleted  his  or  her  education  fairly  recently,  reported  unemployment 
iay  reflect  a  single  episode  of  leisurely  job  search  or  unrealistic 
age  expectations.  Summer  unemployment  by  those  who  have  never  left 
chool  ought  to  be  treated  as  possibly  the  common  experience  of  many 
oung  people.  Someone  who  has  worked  long  enough  in  the  past  to  be 
ligible  for  state  unemployment  compensation  may  misreport  actual 
onparticipation  as  unemployment. 

A  further  problem  of  definition  arises  because  many  chronically 
obless  youths  may  not  show  up  in  unemployment  statistics  at  all . 
tiscouraged  workers  are  counted  among  those  who  are  not  even  part  of 
he  labor  force  in  a  particular  week.  They  may  have  been  unemployed 
or  a  long  period  in  the  recent  past,  they  may  be  permanent  school- 
eavers,  and  they  may  have  low  reservation  wages,  but  unless  they 
ngage  in  specific  search  activities  they  are  not  counted  as  part  of 
he  unemployed  labor  force.  In  addition  to  being  too  inclusive  an 
ndicator  of  chronic  joblessness,  youth  unemployment  may  be  too 
xclusive. 

Another  important  statistical  problem  plaguing  empirical  work  on 
outh  labor  force  behavior  has  sometimes  been  called  "ecological 
orrelation  bias"  (see  Freeman,  1982:115). 19  Much  of  the  empirical 
-ork  on  unemployment  has  used  the  Standard  Metropolitan  Statistical 
rea  (SMSA) ,  not  the  individual,  as  the  unit  of  observation.20  The 
proportion  of  variation  in  labor  force  behavior  across  areas  that  is 
enerally  explained  by  SMSA  regressions  is  much  higher  than  the  pro¬ 
portion  of  variation  across  individuals  that  is  explained  by  regressions 
sing  individuals.  Individual  regressions  may  attribute  to  individual 
iharacteristics  (such  as  education,  race,  and  family  income)  explanatory 
ower  that  really  belongs  to  area  variables  (such  as  the  density  of 
mployment  opportunities)  that  are  correlated  with  the  individual 
haracter istics .  It  is  surprising  that  few  studies  of  individual  labor 
:orce  behavior  have  made  use  of  area  information  that  may  be  available 
albeit  at  great  cost)  even  in  microdata.21 


9Rosen  (1984) ,  reporting  on  data  from  a  BLS  cooperative 
iederal-state  statistical  program,  indicates  that  there  is  a  great  deal 
if  variation  in  unemployment  among  local  areas.  In  1979,  local 
inemployment  rates  ranged  from  40  percent  in  Menominee  County, 
risconsin,  to  less  than  1  percent  in  Sioux  County,  Nebraska. 

°Examples  are  Gilman  (1965),  Kalachek  (1969),  Fleisher  and  Rhodes 
(1976),  and  part  of  Freeman  (1982).  These  SMSA  regressions  generally 
ixplain  a  much  higher  proportion  of  variation  in  SMSA  unemployment  than 
.s  explained  (typically  well  under  10  percent)  in  individual 
egressions . 

:1Abowd  and  Killingsworth  (1984)  are  an  exception,  although  one  might 
fuibble  with  their  choice  of  geographic  area  variables  to  match  with 


to  eununace  a  ctuuDxeaoiue  uxas  iuajs.xuy  uuici  dndxuyies  co 
labor  force  models  for  more  aggregated  data.  By  direct  analogy  to 
recent  analysis  by  Fleisher  and  Rhodes  (1976)  using  SMSA  data,  a  me 
to  be  estimated  using  microdata  ought  to  have  at  least  two  sirnultar 
equations,  one  for  an  individual's  probability  of  labor  force  part: 
pation  and  one  for  his  probability  of  unemployment  conditional  on  ] 
force  participation.  In  the  participation  equation,  a  coefficient 
the  unemployment  probability  would  give  the  discouraged-worker  effe 
while  a  coefficient  on  an  unemployment  dummy  variable  for  other  mei 
of  the  household  would  give  the  added-worker  effect.  If  a  separate 
conditional  unemployment  probability  equation  was  estimated  for  eac 
labor  market,  using  only  the  young  labor  force  participants  in  that 
labor  market,  the  ecological  correlation  problem  might  be  reduced. 


A  Structural  Model  for  the  Youth  Labor  Market 

An  alternative  and  even  more  direct  approach  to  these  problems 
modeling  the  youth  labor  market  is  available.  An  appropriate,  thoi 
likely  quite  expensive,  empirical  framework  might  generalize  recenl 
work  by  Heckman  (1979)  in  the  following  way. 

Suppose  that  a  microdata  sample  has  i  young  people,  and  that  e< 
individual  is  revealed  to  live  in  one  of  j  geographic  areas,  which 
be  considered  separate  labor  markets.  Let  M^ ,  ,  and  S^ 

be  dummy  variables  for  individual  i  for  unconditional  employment, 
unemployment,  nonparticipation,  and  school  enrollment,  respectively 
Let  j  (i)  be  the  geographic  area  in  which  individual  i  lives.  Let 
Zj  (jj  be  a  vector  of  characteristics  (such  as  the  proportion  of 
working-age  people  who  are  young  and  the  fraction  of  jobs  that  do  r 
require  much  skill)  associated  with  area  j  (i)  .  Let  be  a  vector 
characteristics  (such  as  number  of  years  of  schooling  and  area  type 
within  the  geographic  area)  specific  to  individuals.  Let  w(i)  be  t 
wage  for  individual  i . 

Then  consider  the  system  of  equations, 

Pr(Ui=l;  N-[=0)  =  PU;£  =  Pui<Xyir  zuj  (i) '  wi) 

Pr(Ni=0)  =  PNi  =  PNi(XNi,  wi#  PUi) 

Pr(Si=0)  =  Psi  =  Psi(Xsi,  Zsj(i),  wif  PUi) 

wi  =  Wi(Xwi,  Zwj(i),  PUi) 

This  system  of  simultaneous  equations  uses  some  of  the  findings 
the  literature  on  the  youth  labor  market  to  impose  an  empirically 
testable  structure  on  microdata.22  For  example,  the  hypothesis  of 


22Most  likely,  the  best  data  set  for  this  purpose  is  the  1976  Surv< 
of  income  and  Education.  It  is  three  times  as  large  as  the  monthl; 
and  has  more  wage  and  geographic  data  revealed  for  individuals  thai 
does  the  census  microdata.  Abowd  and  Killingsworth  (1984)  and  Fre< 
(1982)  chose  it. 
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Fearn  (1968)  that  unemployment  may  be  strongly  associated  with  school 
enrollment  and  that  wages  have  a  weak  effect  could  be  tested  directly 
with  the  third  equation;  the  second  equation  would  pick  up  any 
discouraged-worker  effect  as  a  negative  coefficient  on  unemployment; 
and  so  on. 

Much  of  the  difficulty  in  empirical  work  on  the  youth  labor  market 
stems  from  fairly  complex  sample-selection  problems,  which  the  model 
presented  here  could  capture.  Wages  are  observed  only  for  those  who 
are  employed;  for  everyone  else,  they  must  be  imputed.  Most  important, 
conditional  unemployment  is  observed  only  for  those  who  participate  in 
the  labor  force;  a  conditional  probability  of  unemployment  must  be 
imputed  to  those  who  are  out  of  the  labor  force.  By  straightforward 
extension  of  Heckman's  work,  a  multivariate,  normal-error  structure  for 
the  four  equations  could  accommodate  this  sample  selection  and  thus 
capture  information  that  might  be  otherwise  lost.  To  reduce  the 
computational  complexity  and  cost,  the  last  two  equations  could  be 
dropped  and  wages  ignored,  which  would  produce  a  microeconometric  model 
more  like  the  Fleisher-Rhodes  model  for  SMSA  data. 


NONSTUDENT  TEENAGERS,  AGED  16-19 
Sample  Selection  and  Descriptive  Statistics 

Table  2  shows  how  two  groups  of  black  male  teenagers  were  selected 
from  the  1980  Census  1  percent  Sample  C,  and  how  two  groups  of  white 
male  teenagers  were  chosen  from  the  0.1  percent  C  subsample.  Table  3 
shows  how  four  similar  groups  of  black  and  white  female  teenagers  were 
chosen  for  analysis.  Of  12,090  black  males  aged  16-19,  340  were  inmates 
of  institutions;  54  of  6,950  whites  were  inmates.  Of  the  remaining 
11,750  black  and  6,896  white  male  teens,  3.7  percent  and  2.4  percent, 
respectively,  were  in  the  armed  forces.  (The  8,239  black  male  students 
and  4,856  white  male  students  will  be  discussed  below.)  There  remain 
3,082  black  male  civilian  noninmate,  nonstudents,  1,805  of  whom  are 
labor  force  participants.  In  addition,  1,875  white  civilian  noninmate  , 
nonstudent  male  teens  have  been  selected,  1,577  of  whom  are  labor  force 
participants.  Almost  56  percent  of  the  black  male  noninmate,  non¬ 
students  are  located  in  the  Census  Bureau's  "South "  region;  little  more 
than  6  percent  live  in  the  "West."  In  contrast,  the  white  nonstudents 
are  distributed  more  evenly.  As  in  the  case  of  the  blacks,  the  South 
has  the  largest  share  of  the  sample  population  and  the  West  has  the 
smallest,  but  the  shares  range  only  between  18  and  33  percent. 

Tables  4  (a) -4(h)  present  descriptive  statistics  for  the  four  black 
samples  and  the  four  white  samples.  The  tables  reveal  some  very 
striking  gross  racial  differences  in  labor  force  behavior.  First,  41.4 
percent  of  the  black  males,  but  only  15.9  percent  of  the  white  males, 
are  out  of  the  labor  force  as  well  as  out  of  school.  Employment- 
population  ratios  are  68.6  percent  for  white  males  and  40.7  percent  for 
black  males.  Among  labor  force  participants,  the  white  male 
unemployment  rate  is  18.5  percent,  but  the  black  male  unemployment  rate 


TABLE  2  Sample  Selection:  Civilian,  Nonstudent,  Teenage  Labor  Force  Participants,  Males 
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TABLE  4(a)  Civilian,  Nonstudent  Teenagers,  Male  Blacks 
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TABLE  4(c)  Civilian,  Nonstudent  Teenage  Labor  Force  Participants,  Male  Blacks 
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TABLE  4(e)  Civilian,  Nonstudent  Teenagers,  Female  Blacks 
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TABLE  4(g)  Civilian,  Nonstudent  Teenage  Labor  Force  Participants,  Female  Blacks 
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is  30.5  percent.23  Among  the  young  women,  55.4  percent  of  the  blacks 
and  32.3  percent  of  the  whites  were  out  of  the  labor  force  as  well  as 
out  of  school.  Among  the  rest  of  the  young  women,  the  unemployment 
rate  was  32.2  percent  for  blacks  and  13.5  percent  for  whites. 

As  one  might  expect,  considering  the  transition  from  school  to  wor 
that  they  are  making,  nonstudent  teenagers  who  participate  in  the  labo 
force  are  a  bit  older  and  have  completed  a  bit  more  education  than  the 
group  as  a  whole,  regardless  of  race  or  sex.  But  it  is  surprising  tha 
1979  household  income,  excluding  the  teenager's  1979  earnings,  is 
greater  for  the  labor  force  participants  than  for  the  group  as  a  whole 
Among  the  young  men,  the  effect  is  much  larger  among  black  teenagers 
than  among  the  white  group.  Among  the  young  women,  the  difference 
between  means  is  slightly  larger  for  whites. 

The  fraction  of  black  male  nonstudents  who  are  out  of  the  labor 
force  is  2.6  times  the  fraction  of  white  males;  this  ratio  is  1.7  for 
females.  So  one  important  question  is.  What  accounts  for  the  tremendo 
differences  in  labor  force  participation  rates?  In  particular,  what 
proportion  of  each  racial  group  is  made  up  of  probable  discouraged 
workers? 


Labor  Force  Status 

Without  placing  too  restrictive  a  structure  on  the  data,  participa 
tion,  employment,  and  unemployment  can  be  expected  to  be  related  to 
age,  region,  area  type,  years  of  education  completed,  a  marital  status 
dummy  variable  (FAM) ,  disability,  and  household  income  net  of  the 
teenager's  earnings.  Region  may  to  some  extent  reflect  the  structure 
of  wages  and  job  availability  in  local  economies.  Area  type  would 
capture  some  of  these  same  forces  but,  unlike  region,  would  be  highly 
correlated  with  individual  and  family  characteristics.  Since  young 
people  generally  make  gradual  transitions  from  school  to  work,  years  o 
education  completed,  especially  those  in  excess  of  12,  ought  to 
increase  labor  force  participation  and  employment.  The  greater 


23When  these  labor  force  and  unemployment  statistics  for  nonstudents 
are  added  to  those  reported  in  Table  8  for  students,  national 
unemployment  rates  comparable  to  those  reported  by  the  BLS  emerge.  Th 
implied  rates  are  14.6  percent  for  white  male  teens  and  26.9  percent 
for  black  male  teens.  The  period  census  respondents  were  asked  about 
overlaps  with  two  BLS  survey  periods,  those  for  March  and  April  1980. 
Unemployment  rates,  not  seasonally  adjusted,  from  Employment  and 
Earnings,  bracket  neatly  the  white  teenage  rate  in  this  paper.  White 
male  teenage  unemployment  as  a  percentage  of  the  civilian 
noninstitutional  labor  force  aged  16-19  was  14.1  percent  for  April  and 
14.7  percent  for  March.  However,  the  analog  here  to  the  volatile 
"black  and  other"  teenage  unemployment  rate  reported  by  the  BLS  is  not 
as  close;  those  BLS  rates  were  27.7  percent  for  April  and  32.3  percent 
for  March. 


financial  responsibilities  of  married  teenagers  ought  to  increase  their 
participation  and  make  voluntary  unemployment,  but  not  involuntary 
unemployment,  less  likely  for  them.  A  disabled  teenager  ought  to  be 
less  likely  to  participate  in  the  work  force  and  less  likely  to  find 
employment  when  he  does.  Low  household  income  ought  to  impel  a  teenager 
into  the  work  force,  but  it  might  also  reflect  poor  job  opportunities 
for  every  member  of  the  family,  or  serve  as  a  proxy  variable  for  poorer- 
quality  schools. 

Exploratory  regressions  were  run  using  these  and  other  variables  to 
explain  unconditional  and  conditional  labor  force  status  in  subsamples 
of  young  men  of  the  same  race.  Repeated  attempts  to  use  three  regional 
dummies  (for  North  Central,  West,  and  South)  and  three  area  type  dummies 
(for  rural,  urban  outside  urban  area,  and  central  city)  generally  were 
unsuccessful  for  participation,  employment,  and  unemployment  equations 
in  all  subsamples.  Only  the  dummy  variables  for  central  city  area  and 
for  the  South  region  consistently  were  significant;  often,  the  South 
coefficient  was  large  and  extraordinarily  significant.  Thus,  in  the 
linear  and  logistic  regressions  reported  here,  central  city  and  South 
are  the  only  geographic  dummy  variables  used.  Intercepts  pick  up, 
along  with  other  unidentified  effects,  the  unidentified  contributions 
of  living  outside  the  South  and  outside  the  central  city. 


Gross  Effect  of  Race  on  Unemployment 

In  Tables  5  (a) -5(d),  linear  probability  models  of  multiple  choice 
are  used  to  show  quite  clearly  the  gross  racial  differentials  in  the 
labor  force  behavior  of  young  people.  The  table  has  four  parts,  in 
parts  (a)  and  (b) ,  all  young  men  aged  16-19  who  were  not  enrolled  in 
school  are  included.  In  parts  (b)  and  (d) ,  only  nonenr oiled  labor 
force  participants  are  included.  In  each  model,  the  intercept  is 
simply  the  value  for  whites,  while  the  coefficient  on  color  gives  the 
racial  difference.  For  example,  in  "MODELO 3 "  of  part  (a) ,  just  as  in 
Table  4(b),  precisely  15.8933  percent  of  male  white  teenagers  are  seen 
to  be  out  of  the  labor  force.  The  figure  for  blacks  is  25.6908  percent 
higher,  for  a  total  black  male  percentage  of  41.584.  This  figure  is 
slightly  different  from  the  41.4341  percent  given  in  Table  4(a)  because 
there  are  only  one-tenth  as  many  blacks  as  before.  Because  unemploy¬ 
ment,  employment,  and  nonparticipation  partition  the  sample  in  (a),  the 
intercepts  in  the  first  three  equations  must  sum  to  unity  and  the 
coefficients  must  sum  to  zero.24 


24Pindyck  and  Rubinfeld  (1981:301-303)  provide  the  trivial  and 
tedious  details.  In  essence,  even  when  X  and  Y  are  dummy  variables, 

LPM  coefficient  estimates  are  computed  using  the  usual  OLS  formula,  b  = 
(X'X) -lx' Y.  The  first  factor,  the  inverted  cross-product  matrix, 
contains  totals  of  individuals  of  each  race  to  be  used  as  the 
denominators  of  the  coefficient  estimates.  The  second  factor  has  the 
counts  of  labor  force  status  by  race  to  be  used  as  numerators. 
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TABLE  5(a)  Linear  Probability  Models:  Civilian,  Nonstudent  Male  Teenagers 


MODEL: 

DEP  VAR: 

VARIABLE 

INTERCEPT 

COLOR 

MODEL: 

DEP  VAR: 

VAR  I  ABLE 
1  NTERCEPT 
COLOR 

MODFL: 

DEP  VAR: 

VARIABLE 
I NTERCEPT 
COLOR 


MODELU1 

U 

DT 

1 

1 

MODEL02 

M 

OF 

1 

1 

MODEL. 03 
N 

DF 
1 
1 


SSE 

290.853302 

DF  E 

2176 

MSE 

0. 133664 

ESTIMATE 

ERROR 

0. 155200 

0.008443197 

0.026318 

0.022637 

SSE 

476.853354 

DEE 

2176 

MSE 

0.219142 

ESTIMATE 

ERROR 

0.685867 

0.010811 

-0.283226 

0.028985 

SSE 

324.241827 

DFE 

2176 

MSE 

0. 149008 

ESTIMATE 

ERROR 

0. 158933 

0.008914653 

0.256908 

0.023901 

E  RATIO 

PROB>E 

R-SQUARE 

1 .35 
0.2451 
0.0006 

T  RATIO 
18.3817 

1 . 1626 

PR0B> | T  | 

0 . 0001 
0.2451 

F  RATIO 

PR0B>E 

R-SQUARE 

95.48 
0.0001 
0 . 0420 

T  RATIO 
63.4421 
-9.7716 

PROB> | T I 
0.0001 
0.0001 

F  RATIO 
PROB>  F 
R-SQUARE 

115.54 

0.0001 

0.0504 

T  RATIO 
17.8283 
10.7489 

PROB> | T  | 
0.000  1 
0.0001 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 


percent  subsample. 


TABLE  5(b)  Linear  Probability  Models:  Civilian,  Nonstudent  Labor  Force 


Participants,  Male  Teenagers 


MODEL:  M0DEL21 

SSE 

275.212078 

F  RATIO 

16.14 

DFE 

1752 

PROB>F 

0.0001 

DEP  VAR:  U 

MSE 

0.157085 

R-SQUARE 

0.0091 

PARAMETER 

STANDARD 

VAR  1  ABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> I T | 

1 NTERCEPT 

1 

0.184528 

0.009980467 

18.4889 

0.0001 

COLOR 

1 

0.126207 

0.031418 

4.0170 

0 . 0001 

MODEL:  M0DF.L22 

SSE 

275.212078 

F  RATIO 

16.14 

DFE 

1752 

PROB>F 

0 . 0001 

DEP  VAR:  M 

MSE 

0.157085 

R-SQUARE 

0.0091 

PARAMETER 

STANDARD 

VAR  1  ABLE 

or 

ESTIMATE 

ERROR 

T  RATIO 

PR0B> | T | 

1 NTERCEPT 

1 

0.815472 

0.009980467 

81.7068 

0.0001 

COLOR 

1 

-0. 126207 

0.031418 

-4.0170 

0.0001 

MODEL:  MODEL3 1 

SSE 

269.970506 

F  RATIO 

16.80 

DFE 

1750 

PROB>F 

0.0001 

DEP  VAR:  U 

MSE 

0.154269 

R-SQUARE 

0.0280 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PR0B> | T | 

I  NTERCEPI 

1 

0.209542 

0.012013 

17.4430 

0.0001 

SO 

1 

-0.077652 

0.021166 

-3.6687 

0.0003 

COLOR 

1 

0.262681 

0.047822 

5.4929 

0.0001 

1  NTRACT 

1 

-0.194570 

0.063717 

-3.0537 

0.0023 

MODEL:  MODEL32 

SSE 

269.970506 

F  RATIO 

16.80 

DFE 

1750 

PR0B>F 

0.0001 

DEP  VAR:  M 

MSE 

0.154269 

R-SQUARE 

0.0280 

PARAMETER 

STANDARD 

VARIABLE 

nr 

EST IMATE 

ERROR 

T  RATIO 

PR0B> | T I 

1 NTERCEPT 

i 

0.790458 

0.012013 

65.8004 

0.0001 

SO 

i 

0.077652 

0.021166 

3.6687 

0.0003 

COLOR 

i 

-0.262681 

0.047822 

-5.4929 

0.0001 

1  NTRACT 

i 

0.194570 

0.063717 

3.0537 

0 . 0023 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 


Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


DEP  VAR:  U 

MSE 

0.086457 

K-SUUARt. 

VAR  1  ABLE 

1 NTERCEPT 

COLOR 

DF 

1 

1 

ESTIMATE 

0.091568 

0.026588 

ERROR 

0.006687799 

0.017143 

T  RATIO 
13.6917 
1.5510 

PR0B> IT | 
0.0001 
0.1210 

MODEL:  MODEL02 

DF'P  VAR:  M 

SSE 

DFE 

MSE 

538.071541 

2278 

0.236203 

F  RATIO 

PROB>F 

R-SQUARE 

121.12 

0.0001 

0 .0505 

VARIABLE 

INTERCEPT 

COLOR 

DF 

1 

1 

ESTIMATE 

0.585618 

-0.311843 

ERROR 

0.01 1054 
0.028335 

T  RATIO 
52.9770 
-1 1 .0054 

PROB> | T | 
0.0001 
0.0001 

MODEL:  M0DEL03 

DEP  VAR:  N 

SSE 

DFE 

MSE 

505.261297 

2278 

0.221800 

F  RATIO 
PROB>  F 
R-SQUARE 

107.93 

0.0001 

0.0452 

VARIABLE 

INTERCEPT 

COLOR 

DF 

1 

1 

ESTIMATE 

0.322814 

0.285255 

ERROR 

0.010712 

0.027458 

T  RATIO 
30.1361 
10.3888 

PROB> I T I 
0.0001 
0.0001 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S^ 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 

percent  subsample. 


TABLE  5(d)  Linear  Probability  Models:  Civilian,  Nonstudent  Labor  Force 
Participants,  Female  Teenagers  _ _ _ - 


MODEL:  M0DEL21 

DFP  VAR:  U 

SSE 

DFE 

MSE 

181 .706169 

1443 

0.125923 

F  RATIO 
PROB>  F 
R-SQUARE 

27.04 

0.0001 

0.0184 

VARIABLE 

1  NTERCEPT 

COLOR 

DF 

1 

1 

PARAMETER 
ESTIMATE 
0.1 35218 
0.166253 

STANDARD 

ERROR 

0.009808031 

0.031970 

T  RATIO 
13.7864 
5.2002 

PROB> I T | 
0.0001 
0.0001 

MODEL:  MODEL22 

DTP  VAR:  M 

SSE 

DFE 

MSE 

181 .706169 
1443 
0.125923 

F  RATIO 
PR0B>  F 
R-SQUARE 

27.04 

0.0001 

0.0184 

VARIABLE 

INTERCEPT 

COLOR 

DF 

1 

1 

PARAMETER 

ESTIMATE 

0.864782 

-0.166253 

STANDARD 

ERROR 

0.009808031 

0.031970 

T  RATIO 
88. 1708 
-5.2002 

PROB> I T | 
0.0001 
0.0001 

MODEL:  M0DEL31 

DEP  VAR:  U 


SSE  181.559482 
DFE  1441 
MSE  0.125995 


VARIABLE 

INTERCEPT 

SO 

COLOR 
I  NTRACT 


PARAMETER 
DF  ESTIMATE 

1  0.135347 

1  -0.000406997 
1  0.203636 

1  -0.065849 


STANDARD 

ERROR 

0.011872 

0.021084 

0.047712 

0.064934 


F  RATIO 
PR0B>  F 
R-SQUARE 


T  RATIO 
1 1.4009 
-0.0193 
4.2680 
-1.0141 


9.40 

0.0001 

0.0192 


PR0B> I T | 
0.0001 
0.9846 
0.0001 
0.3107 


MODEL:  M0DEL32 

DEP  VAR:  M 


SSE  181.559482 
DFE  1441 
MSE  0.125995 


VARIABLE 
I NTERCEPT 
SO 

COLOR 
I NTRACT 


PARAMETER 
DF  ESTIMATE 

1  0.864653 

1  0.0004069971 
1  -0.203636 

1  0.065849 


STANDARD 

ERROR 

0.011872 

0.021084 

0.047712 

0.064934 


F  RATIO 
PROB>  F 
R-SQUARE 


T  RATIO 
72.8338 
0.0193 
-4.2680 
1.0141 


9.40 

0.0001 

0.0192 


PROB> |T | 
0.0001 
0.9846 
0.0001 
0.3107 


SOURCE-  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sa 
percent  subsample. 
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What  should  we  use  as  our  measure  of  youth  unemployment?  Should  w 
use  the  unconditional  ratio  of  the  number  of  unemployed  to  the  size  of 
the  cohort  displayed  in  parts  (a)  and  (c)  of  Table  5,  or  should  we  use 
from  parts  (b)  and  (d)  the  rate  of  unemployment  conditional  on  partici 
pation  in  the  labor  force?  If  we  choose  the  first  option,  we  need  go 
no  further  in  our  analysis  of  youth  unemployment.  For  both  young  men 
and  young  women,  "MODELOl"  shows  that  the  race  differential  is  small 
and  insignificantly  different  from  zero.25  In  that  case,  our  emphasis 
must  be  on  the  lower  labor  force  participation  rates  and  lower 
employment-to-population  ratios  of  blacks.26 

Clearly,  we  must  focus  attention  on  conditional  measures  of 
unemployment  if  we  are  to  say  anything  sensible  about  racial  differ¬ 
ences  in  youth  unemployment.  The  much  lower  labor  force  participation 
of  blacks  and  their  higher  unemployment  rates  tend  to  cancel  out  each 
other  completely  in  unconditional  measures  of  unemployment.  But 
"MODEL21"  in  Table  5(b)  shows  that  the  gross  male  racial  differential 
is  12.6  percent  and  significant2  7  when  we  use  a  conditional  measure 
of  unemployment.  Since  12.6  percent  is  less  than  the  18.5  percent 
unemployment  rate  for  whites,  however,  among  nonstudent  male  teenagers 
the  widely  believed,  roughly  two-to-one  ratio  of  black  unemployment  to 
white  unemployment  was  too  pessimistic  by  one-third  on  census  day  in 
1980;  it  was  only  1.68. 

What  happens  to  the  gross  differential  when  we  correct  for  region? 
"MODEL31,"  Table  5(b),  tells  us  that  the  ratio  of  black  to  white  male 
youth  unemployment  rates  was  2.25  outside  the  South  but  only  1.52  in 
the  South.28  The  corresponding  ratios  for  women  are  2.5  and  2.0, 


25The  asymptotic  t-statistic  for  a  logit  version  of  "MODELOl"  is  only 
1.16;  the  LPM  does  not  lead  us  astray  here. 

2 6 Freeman  (1982:116)  gives  as  one  of  four  "basic  findings"  the 
following:  "Because  determinants  of  youth  unemployment  often  have  the 
same  directional  impact  on  labor  force  participation  rates  as  on 
employment,  [they]  have  little  effect,  or  occasionally  a  contradictory 
effect,  on  unemployment  rates.  This  suggests  that  analyses  focusing  o 
unemployment  can  give  misleading  impressions  about  the  determinants  of 
the  youth  labor  market  position."  Indeed,  the  advance  title  of  the 
conference  at  which  Freeman  presented  his  important  paper  was  not  "The 
Youth  Labor  Market  Problem,"  but  rather  "Youth  Unemployment."  The 
approach  here  permits  a  more  direct  attack. 

2  7 The  asymptotic  t-statistic  from  the  logistic  regression,  3.94, 
confirms  the  LPM  result. 

2  “The  LPM  framework  gives  unemployment  rates  for  white  Southerners, 
black  non-Southerners,  and  black  Southerners  as  sums  of  the 

coefficients.  For  example,  the  rate  for  black  Southerners  is  the  sum 
of  all  four  coefficients. 


Table  5(d).  These  differences  reflect  larger  regional  differentials  in 
unemployment  rates  for  blacks  than  for  whites,  especially  among  young 
men.  The  unemployment  rate  for  southern  black  males  was  only  42 
percent  of  the  rate  for  nonsouthern  black  males,  while  the  geographic 
ratio  of  unemployment  rates  for  white  males  was  much  higher,  at  almost 
63  percent.  From  Table  4(a),  we  know  that  an  astounding  56.8  percent 
of  the  black  male,  nonstudent  labor  force  participants  live  in  the 
South.  Were  this  not  so,  the  national  ratio  of  male  unemployment  rates 
by  race  would  be  much  higher  than  1.68. 


Gross  Effect  of  Race  on  Other  Labor  Force  Status  Variables 

Table  5  shows  that  what  was  said  before  about  the  linear  probability 
model  was  correct?  in  any  set  of  LPM  regressions  of  dependent  variables 
that  partition  the  sample,  the  intercept  coefficients  must  sum  to  unity 
and  the  slopes  to  zero.  When,  as  in  part  (b) ,  just  two  labor  market 
states  partition  the  sample,  one  of  the  two  LPM  regressions  is  redun¬ 
dant.  In  "MODEL22,"  the  intercept  is  the  difference  between  unity  and 
the  intercept  in  "M0DEL21."  This  simply  means  that  the  rate  of  white 
employment,  conditional  on  labor  force  participation,  is  one  minus  the 
white  unemployment  rate.  The  slope  restriction  simply  ensures  that  the 
racial  difference  in  conditional  employment  rates  has  the  same  absolute 
value  as  the  racial  difference  in  unemployment  rates. 

In  parts  (a)  and  (c)  of  the  table,  the  race  coefficients  for 
unconditional  employment  and  nonparticipation  show  how  the  uncon¬ 
ditional  unemployment  ratios  came  to  be  nil.  Among  males,  a  28.3 
percent  gross  racial  differential  in  employment-to-population  ratios  is 
offset  almost  exactly  by  a  25.7  percent  racial  differential  in  labor 
force  participation.  Among  females,  a  31.2  percent  gross  racial 
differential  in  employment-population  ratios  is  offset  by  a  28.5 
percent  racial  differential  in  labor  force  participation. 


Structural  Interpretation 

There  are  two  strikingly  different  structural  interpretations  for 
the  racial  differential  in  labor  force  participation.  Freeman  (1982) 
and  others  have  found  little  difference  between  the  wages  of  employed 
black  and  white  young  people.29  Heckman  (1974) ,  implementing  neo¬ 
classical  labor  force  participation  theory  empirically,  shows  how  a 
woman  observed  outside  the  labor  force  can  be  modeled  as  having  an 
imputed  market  wage  below  her  personal  reservation  wage.  If  Heckman's 
model  is  applied  to  the  youth  labor  market,  ignoring  unemployment,  then 


2 9 Freeman  (1982:142)  reports  S1E  log  hourly  earnings  regressions 
showing  only  a  3  percent  disadvantage  for  blacks  aged  18-19  and  blacks 
aged  20-24.  For  16-17  year  olds,  he  reports  an  actual  wage  advantage 
of  17  percent  for  blacks. 
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an  explanation  for  lower  black  participation  is  higher  black  re 
wages.  On  the  other  hand,  if  the  analogy  to  macroeconomic  mode 
posited  above  is  maintained,  the  lower  black  participation  is  a 
discouraged-worker  effect  consistent  with  the  higher  black  unem 
rate . 


The  Effect  of  Additional  Explanatory  Variables 

For  the  reasons  stated  above,  it  might  be  unwise  to  place  m 
faith  in  structural  estimates  of  the  effect  of  race  on  unemploy 
based  on  single-equation  techniques,  or  even  on  system  techniqu 
ignoring  the  complex  sample  selection  used  to  generate  data  on 
unemployment,  wages,  and  school  enrollment.  Thus  far,  the  focu 
been  on  merely  measuring  gross  effects  of  race  on  unemployment, 
estimates  presented  in  this  section  should  be  considered  much  m 
tentative,  because  of  the  many  sources  of  bias  that  have  not  be 
corrected  here. 

Tables  6  (a) -6(d)  present  estimates  of  conditional  unemploym 
probabilities  for  nonstudents.  In  parts  (a)  and  (c)  of  the  tab 
use  of  age  as  a  regressor  reduces  the  strong  impact  of  years  of 
education  that  is  present  in  parts  (b)  and  (d) ;  in  fact,  age  re 
education  as  the  greatest  reducer  of  chi-square.  Southern  loca 
keeps  the  strong  negative  effect  on  the  chance  of  male  unemploy 
that  it  had  in  the  LPM.  The  failure  of  household  income  to  exp 
much  variation  in  male  unemployment  is  surprising  if  unemployme 
voluntary  search;  perhaps  replacing  household  income  with  a  dum 
variable  for  unemployment  of  the  head  of  the  household  would  pr 
stronger  effect.  Race  has  the  largest  effect  of  all  the  dummy 
variables  and  still  seems  to  have  a  strong  impact  on  unemployme 

In  parts  (a)  and  (c)  of  Table  7,  there  is  still  no  signific 
racial  difference  in  unemployment  ratios  even  after  adjustment 
other  individual  characteristics.  Parts  (b)  and  (d)  of  the  tab 
how  race  affects  nonparticipation  when  no  discouraged-worker  ef 
have  been  permitted  to  occur  in  the  equation.  Comparison  of  pa 
and  (d)  of  Table  7  shows  how  remarkably  the  effect  of  marital  s 
(FAM)  differs  by  sex.  There  is  no  independent  effect  of  southe 
location  on  young  women's  participation,  even  though  the  effect 
strong  for  young  men. 


STUDENT  TEENAGERS,  AGED  16-19 

Sample  Selection  and  Descriptive  Statistics 

Parts  (a)  through  (d)  of  Table  8  contain  descriptive  statis 
4,856  white  male  students  from  the  0.1  percent  C  subsample  and 
8,239  black  male  students  from  the  full  1  percent  sample.  Part 
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TABLE  6(a)  Conditional  Unemployment  Probabilities  Using  Age  as  a  Regressor, 
Civilian,  Nonstudent  Labor  Force  Participants,  Male  Teenagers 

LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


1754  OBSERVATIONS 
346  POSITIVES 
1408  NEGATIVES 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  0NLY=  1742,02 


CONVERGENCE  OBTAINED  IN  5  ITERATIONS. 
MAX  ABSOLUTE  DER I  VAT  I VE=0 . 2 1 12D-02 . 
MODEL  CH I -SQUARE=  97.40  WITH  10  D. F. 


-2 


D=0 . 053 . 
LOG  L=  1644.62. 


P=0.0 


VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

D 

INTERCEPT 

5.42764696 

1 .28248823 

17.91 

0.0000 

EDUCATN 

-0.12686428 

0.03384796 

14.05 

0.0002 

0.008 

AGE 

-0.29201459 

0.07284783 

16.07 

0.0001 

0.009 

HH 1 NCOME 

0.00169628 

0.00447408 

0.14 

0.7046 

0.000 

FAM 

-0.29255623 

0.24509834 

1 . 42 

0.2326 

0.001 

D 1  SAB  1 L 

0.46270604 

0.32592203 

2.02 

0.1557 

0.001 

SO 

-0.59775813 

0.15481244 

14.91 

0.0001 

0.008 

CC 

0.25130318 

0.  15277040 

2.71 

0. 1000 

0.002 

SOXCOL 

-0.64729610 

0.39780103 

2.65 

0.1037 

0.002 

CCXCOL 

0.19118747 

0. 39773426 

0.23 

0.6307 

0.000 

COLOR 

0.95430253 

0.36112488 

6.98 

0.0082 

0.004 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C”  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  6(b)  Conditional  Unemployment  Probabilities,  Civilian,  Nonstudent  Labor 
Force  Participants,  Male  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


1754  OBSERVATIONS 
346  POSITIVES 
1408  NEGATIVES  , 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  0NLY=  1742.02 


CONVERGENCE  OBTAINED  IN  5  ITERATIONS. 
MAX  ABSOLUTE  DER I  VAT  I VE=0 . 9685D-03 . 
MODEL  CH I -SQUARE=  81.58  WITH  9  D.F. 


D=0 . 045 . 
-2  LOG  L=  1660.44. 


P=0.0 


VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

D 

INTERCEPT 

0.46768080 

0.35990954 

1.69 

0.1938 

EDUCATN 

-0.17088188 

0.03185640 

28.77 

0.0000 

0.016 

HHI NCOME 

0.00124161 

0.00443305 

0.08 

0.7794 

0 . 000 

FAM 

-0.38980929 

0.24356476 

2.56 

0.1095 

0.001 

DISABIL 

0.44866365 

0.32483203 

1.91 

0.1672 

0.001 

SO 

-0.58287631 

0.  15401052 

14.32 

0.0002 

0.008 

CC 

0.21087438 

0. 15172489 

1 .93 

0. 1646 

0.001 

SOXCOL 

-0.64609606 

0.39641010 

2.66 

0.1031 

0.002 

CCXCOL 

0.15225014 

0.39609317 

0.  15 

0.7007 

0.000 

COLOR 

0.94986882 

0.35936788 

6.99 

0.0082 

0.004 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 
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TABLE  6(c)  Conditional  Unemployment  Probabilities  Using  Age  and  Education  as 
a  Regressor,  Civilian,  Nonstudent  Labor  Force  Participants,  Female  Teenagers 

LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


1445  OBSERVATIONS 
1227  U  =  0 
218  U  =  1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  1225.96 

MODEL  CH I -SQUARE=  82.93  WITH  10  D.F.  (SCORE  STAT. )  P=0.0 

CONVERGENCE  OBTAINED  IN  5  ITERATIONS.  R=  0.209. 

MAX  ABSOLUTE  DERI  VAT  I VE=0 . 5369D-06 .  -2  LOG  L=  1152.29. 

MODEL  CH I -SQUARE=  73.66  WITH  10  D.F.  (-2  LOG  L.R.)  P=0.0 


VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

R 

INTERCEPT 

6.69912234 

1.57608915 

18.07 

0.0000 

EDUCATN 

-0. 17411742 

0.05434578 

10.26 

0.0014 

-0.082 

AGE 

-0.33559105 

0.09334111 

12.93 

0.0003 

-0.094 

HH  1  NCOME 

-0.01201040 

0.00595276 

4.07 

0.0436 

-0.041 

FAM 

-0.22592831 

0.20554140 

1 .21 

0.2717 

0.000 

D 1  SAB  1 L 

0.62566258 

0.40597028 

2.38 

0.1233 

0.017 

SO 

-0.07155320 

0.18027037 

0.16 

0.6914 

0.000 

CC 

-0. 18357430 

0.  19867950 

0.85 

0.3555 

0.000 

SOXCOL 

-0.23789505 

0.44137867 

0.29 

0.5899 

0.000 

CCXCOL 

0.41980877 

0.45426632 

0.85 

0.3554 

0.000 

COLOR 

0.90828910 

0.42853113 

4.49 

0.0340 

0.045 

SOURCE:  Bureau  of  the  Census,  “Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  6(d)  Conditional  Unemployment  Probabilities,  Civilian,  Nonstudent  Labor 
Force  Participants,  Female  Teenagers 

LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


1445  OBSERVATIONS 
1227  U  =0 
218  U  =  1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  0NLY=  1225.96 

MODEL  CH I -SQUARE=  70.27  WITH  9  D.F.  (SCORE  STAT.)  P=0.0 

CONVERGENCE  OBTAINED  IN  5  ITERATIONS.  R=  0  187 

MAX  ABSOLUTE  DER I  VAT  I VE=0 . 2327D-06 .  -2  LOG  L=  1165.10* 

MODEL  CH I -SQUARE=  60.86  WITH  9  D.F.  (-2  LOG  L.R.)  P=0.0 


VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

R 

INTERCEPT 

1 . 36485040 

0.56915190 

5.75 

0.0165 

EDUCATN 

-0.25780649 

0.04916801 

27.49 

0.0000 

-0.144 

HH 1 NCOME 

-0.01 170492 

0.00589019 

3.95 

0.0469 

-0.040 

FAM 

-0.27235321 

0.20377561 

1.79 

0.1814 

0.000 

Dl SABI L 

0.62538138 

0.40353722 

2.40 

0.1212 

0.018 

SO 

-0.06252239 

0. 1791  1250 

0.12 

0.7270 

0.000 

CC 

-0. 19235087 

0. 19765778 

0.95 

0.3305 

0.000 

SOXCOL 

-0.27959955 

0.43968613 

0.40 

0.5248 

0 . 000 

CCXCOL 

0.39196512 

0.45261366 

0.75 

0.3865 

0.000 

COLOR 

0.91665873 

0.42721497 

4.60 

0.0319 

0.046 

SOURCE:  Bureau  of  the  Census,  “Public-Use  Microdata  Sample  C“  (Washington,  D.C.:  U.S. 
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TABLE  7(a)  Unconditional  Unemployment  Probabilities  Using  Age  as  a  Regressor, 
Civilian,  Nonstudent  Male  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2178  OBSERVATIONS 
346  POSITIVES 
1832  NEGATIVES 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  1906.96 

CONVERGENCE  OBTA I  NED  IN  6  ITERATIONS.  D=0.019. 

MAX  ABSOLUTE  DERI  VAT  I VE=0 . 1942D-07.  -2  LOG  L=  1864.66. 


MODEL  CHI 

-SQUARE=  42 

. 29  Wl TH  10  D. F. 

P=0. 

0000. 

VARIABLE 

BETA 

STD.  ERROR 

CH 1 -SQUARE 

P 

D 

INTERCEPT 

0.43564000 

1 . 16266490 

0.  14 

0.7079 

EDUCATN 

-0.09511908 

0.03154844 

9.09 

0.0026 

0.004 

AGE 

-0.05546068 

0.06679326 

0.69 

0.4064 

0.000 

HH 1 NCOME 

0.00338062 

0.00423961 

0.64 

0.4252 

0.000 

FAM 

-0. 1 580631 1 

0.24129147 

0.43 

0.5124 

0.000 

Dl SABI L 

0.05311048 

0.29838801 

0.03 

0.8587 

0.000 

SO 

-0.62447856 

0.15057693 

17.20 

0.0000 

0.008 

cc 

0.17428858 

0. 14758136 

1  .  39 

0.2376 

0.001 

SOXCOL 

-0.22117611 

0.36407431 

0. 37 

0.5435 

0.000 

CCXCOL 

-0. 19581342 

0.36304163 

0.29 

0.5896 

0.000 

COLOR 

0.40942448 

0.32828724 

1.56 

0.2123 

0.001 

SOURCE:  Bureau  of  the  Census, ' 

'Public-Use  Microdata  Sample  C"  (Washington,  D.C. 

,:  U.S. 

Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  7(b)  Labor  Force  Participation  Probabilities,  Civilian,  Nonstudent  Male 
Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  N 


2178  OBSERVATIONS 
424  POSITIVES 
1754  NEGATIVES 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  2147.20 

CONVERGENCE  OBTAINED  IN  6  ITERATIONS.  D=0.122. 
MAX  ABSOLUTE  DERIVATIVES.  1532D-04.  -2  LOG  L=  1845-10. 
MODEL  CH I -SQUARE=  302.10  WITH  10  D.F.  P=0.0 


VARIABLE 

BETA 

STD.  ERROR 

CH 1 -SQUARE 

P 

D 

1 NTERCEPT 

10.66536953 

1 . 08712728 

96.25 

EDUCATN 

-0.07836863 

0.0314401 1 

6.21 

o'.  01  27 

0.003 

AGE 

-0.62317655 

0.06384602 

95.27 

0.042 

HH 1 NCOME 

-0.00667815 

0.00448927 

2.21 

o! 1369 

0.001 

FAM 

-0.92074141 

0. 30599906 

9.05 

0.0026 

0.004 

DISABIL 

0.92544267 

0.25494550 

13.18 

0.0003 

0.006 

SO 

0. 28386695 

0.  13819125 

4.22 

0.0400 

0 . 002 

CC 

0.  14608299 

0. 15444070 

0.89 

0.3442 

0.000 

SOXCOL 

-0.62563728 

0.  30290435 

4.27 

0.0389 

0.002 

CCXCOL 

0.46067254 

0. 31294010 

2.  17 

0. 1410 

0.001 

COLOR 

1 . 25767966 

0.29242890 

18.50 

0.0000 

0.008 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


396 


TABLE  7(c)  Unconditional  Unemployment  Probabilities  Using  Age  as  a  Regressor, 
Civilian,  Nonstudent  Female  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2280  OBSERVATIONS 
2062  U  =0 

218  U  =  1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  L 

1 KEL 1  HOOD  FOR 

MODEL  CONTAINING 

INTERCEPT  0NLY=  1437 

.94 

MODEL  CHI 

-SQUARE=  21. 

24 

WITH  10  D.F. 

( SCORE  STAT. )  P=0 . 

0195. 

CONVERGENCE  OBTAINED  IN 

5  ITERATIONS. 

R=  0 

.037. 

MAX  ABSOLUTE  DERIVATIVE 

=0 

.  3232D-07 . 

-2  LOG  L=  1415.93. 

MODEL  CHI 

-SQUARE=  22. 

01 

WITH  10  D.F. 

(-2  LOG  L. 

R.  )  P=0 . 

0150. 

VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

R 

INTERCEPT 

0.73630620 

1 . 39571223 

0.28 

0.5978 

EDUCATN 

-0.01062479 

0.04807882 

0.05 

0.8251 

0.000 

AGE 

-0.13802017 

0.08384371 

2.71 

0.0997 

-0.022 

HH INCOME 

-0.00702891 

0.00558243 

1.59 

0.2080 

0.000 

FAM 

-0.66409315 

0.19371289 

11.75 

0.0006 

-0.082 

D 1  SAB  1 L 

0.25378135 

0.35259030 

0.52 

0.4717 

0.000 

SO 

-0.06763013 

0.17256885 

0.15 

0.6951 

0.000 

CC 

-0.13627472 

0.18998197 

0.51 

0.4732 

0.000 

S0XC0L 

0.06433473 

0. 39554228 

0.03 

0.8708 

0.000 

CCXCOL 

0.11657359 

0.41129213 

0.08 

0.7768 

0.000 

COLOR 

0.07286950 

0.38902035 

0.04 

0.8514 

0.000 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  7(d)  Labor  Force  Participation  Probabilities,  Civilian,  Nonstudent  Female 
Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  N 


2280  OBSERVATIONS 
1445  N  =0 

835  N  =1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  0NLY=  2995.54 


MODEL  CHI 

1  -SQUARE-  461.55 

WITH  10  D. F. 

(SCORE  STAT. )  P=0.0 

CONVERGENCE  OBTAINED  IN  6 

-  ITERATIONS. 

R=  0. 

395. 

MAX  ABSOLUTE  DERIVATIVES. 

1291D-1  1  . 

-2  LOG  L=  2507 

.26. 

MODEL  CHI 

l  -SQUARE=  488.29 

WITH  10  D. F. 

(-2  LOG  L. 

R.)  P=0.0 

VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE  P 

R 

1 NTERCEPT 

8.82746514 

0.99818280 

78.21 

EDUCATN 

-0.27468560 

0.03455440 

63.19 

0.0000 

-0.143 

AGE 

-0.36753557 

0.05900645 

38.80 

0.0000 

-0.111 

HH INCOME 

-0.01075921 

0.00397012 

7.34 

0.0067 

-0.042 

FAM 

1 .27876118 

0.11323533 

127.53 

0.205 

D 1  SAB  1 L 

0.58214365 

0.26508005 

4.82 

0.0281 

0.031 

SO 

-0.01060688 

0.11394206 

0.01 

0.9258 

0.000 

CC 

0.02361572 

0.12537707 

0.04 

0.8506 

0.000 

SOXCOL 

-0.27130198 

0.27439692 

0.98 

0.3228 

0.000 

CCXCOL 

0.25352076 

0.28274332 

0.80 

0.3699 

0.000 

COLOR 

1.43670015 

0.27092794 

28.12 

0.0000 

0.093 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 


TABLE  8(a)  Descriptive  Statistics:  Civilian,  Student  Teenagers,  Male  Blacks 
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TABLE  8(e)  Descriptive  Statistics:  Civilian,  Student  Teenagers,  Female  Blacks 
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whites,  noninmate  0.1  percent  subsample. 


out  of  the  labor  force,  as  one  might  expect  for  students  at  the  middle 
of  the  spring  term  in  1980 — 56.2  percent  of  all  white  male  students  and 
74.2  percent  of  the  black  male  students  did  not  participate  in  the 
labor  force.  The  black-white  ratio  is  only  1.32,  just  half  the  ratio 
of  participation  rates  for  black  and  white  nonstudents  reported  in  the 
last  section.  Employment-to-population  ratios,  however,  are  worse  for 
black  students  relative  to  white  students  than  they  were  for  black 
nonstudents  relative  to  white  nonstudents.  The  fraction  of  all  white 
male  students  who  had  jobs  was  38.6  percent;  this  was  1.97  times  the 
fraction  of  all  black  male  students  who  had  jobs.  The  ratio  for  male 
nonstudents  was  only  1.67.  The  employment-population  ratio  for  white 
female  students  was  38.2  percent,  2.06  times  the  ratio  for  black  female 
students.  However,  2.06  is  almost  as  high  as  1.94,  the  analogous  ratio 
for  female  nonstudents. 


Labor  Force  Participants 

Of  the  4,856  white  male  students,  2,125  were  labor  force  partici¬ 
pants;  2,123  of  the  8,239  black  students  were  participants.  Even  though 
the  original  sample  contained  2.2  million  people,  only  505  unemployed 
black  male  teen  students  made  it  into  this  final  group.  Of  the  2,125 
white  student  participants,  205  were  unemployed.  This  means  that  the 
black  unemployment  rate  among  teenage  students  was  23.8  percent,  while 
the  white  unemployment  rate  was  11.8  percent.  Note  that  the  ratio  of 
the  black  rate  to  the  white  rate  is  worse  for  male  students  than  it  was 
for  male  nonstudents  %  2.02,  compared  with  1.65  as  computed  from  Table 

4,  or  compared  with  1.68,  as  computed  from  the  LPM  regressions  on  the 
0.1  percent  sample  reported  in  Table  5(a). 

Table  8(h)  shows  that  2,013  of  the  4,811  white  female  students  were 
labor  force  participants;  part  (g)  of  the  same  table  shows  that  2,065 
of  the  8,505  black  female  students  participated  in  the  labor  force. 

Some  176  of  the  whites  and  489  of  the  blacks  were  unemployed,  which 
yields  female  student  rates  of  8.7  percent  and  23.7  percent,  respec¬ 
tively.  The  black-white  ratio  of  female  student  unemployment  rates 
computed  from  this  table  is  2.71.  Since  parts  (g)  and  (h)  of  Table  4 
imply  a  nonstudent  ratio  of  2.38,  the  racial  ratio  of  unemployment 
rates  is  worse  for  female  students  as  well  as  for  male  students. 


Gross  Effect  of  Race  on  Unemployment 

In  Tables  9(a)-9(d)  are  linear  probability  models  exactly  like 
those  in  Table  5,  but  this  time  they  are  estimated  for  students. 
"MODEL01"  of  Table  9 (a)  shows  that  the  gross  racial  differential  in 
male  unemployment-population  ratios  was  1.55  percent  and  of  marginal 
statistical  significance.30  Part  (c)  of  the  table  shows  a  slightly 


30Like  the  LPM  coefficient,  the  logistic  coefficient  is  small  and 
barely  significant  at  the  7  percent  level.  In  the  sample  restricted  to 
labor  force  participants,  the  logistic  coefficient  on  race  is  large  and 
has  an  asymptotic  t-statistic  of  5.8. 


TABLE  9(a)  Linear  Probability  Models:  Civilian,  Student  Male  Teenagers 


mod Fi  :  hoi) run 

SSE. 

287.51 1459 

F  RATIO 

3 . 28 

DTE 

5660 

PROB  -F 

0.0704 

DF  P  VAH  :  l) 

MSE 

0.050797 

R-SQUARE 

0 . 0006 

VAR  1  ABI  F 

OF 

F  ST  1  MAI F 

ERROR 

T  RA1  10 

PR0B> | 1 | 

1 N 1 F  KCF  P  1 

1 

0 . OS  148 3 

0.003234298 

15.9177 

l) .  1)00  1 

COL  OK 

1 

( ) .  0 1  5  5  1  5 

0.008572301 

1 . 8099 

0. 0  70  4 

F-10DF  1  :  MOF)[  LOP 

SSE 

1272.48 

E  RATIO 

124 . 5 Ft 

DF  F. 

5660 

PROB>  F 

0 . 000 1 

DEP  VAR:  M 

MSE 

0 . 224820 

R-SQOARE 

0.0215 

VAR  1  ABI  l 

F)T 

ESTIMATE 

ERROR 

T  RAT  1 0 

PROB> I T | 

1  NT  f KCf  PI 

1 

0. 386120 

0.006804213 

56.  747? 

0.0001 

COl.OK 

1 

-0. 201257 

0.018034 

-11.1 598 

0 . 1)00  1 

MOOtl:  MODI  103 

SSE 

1346.966 

1  RA 1 1 0 

100.21 

DF  E 

5660 

PR0B--F 

0. 01)01 

DF  P  VAR:  N 

MSE 

0.237980 

R-SQUARE 

0.01  7'l 

VARIAIU  f 

m 

F  S 1  1 MA 1 F 

ERROR 

1  RATIO 

PROB-'  |  1  I 

1 NFLRCL  PI 

i 

0.56239 7 

0 . 00  700092  7 

80. 3364 

0  .  Dill)  1 

COl  OK 

i 

().  18  5  74? 

0.018594 

10.0106 

/) .  000  1 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington, 

D.C.:  U.S. 

Department  of  Commerce, 

1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate 

0.1  percent  subsample. 

TABLE  9(b)  Linear  Probability  Models:  Civilian,  Student  Labor  Force 

Participants,  Male  Teenagers 

MODEl  :  M0DEL21 

SSE 

260.223703 

F  RATIO 

36. 46 

DF  E 

2326 

PROB>  F 

0.0001 

DEP  VAft:  U 

MSE 

0. 1  11876 

R-SQUARE 

0 . 0154 

PARAMF  FFR 

STANDARD 

VAR  1 ABI  r 

DT 

ESTIMATE 

ERROR 

T  RATIO 

PROB> | T | 

INTERCEPT 

1 

0.11  7  6  F 1 7 

0.007255864 

16.21/41 

0 . 000  1 

COL  OK 

1 

0.  148363 

0.024572 

6.0380 

0. 000 1 

MODI  1  :  MODI  L.22 

SSE 

260.223703 

F  RA1  10 

36.46 

DF  E 

2326 

PROB>  F 

0.0001 

DF  P  VAR:  M 

MSE 

0. 1 11876 

R-SQUARE 

0.0154 

PARAMETER 

STANDARD 

VAR  1  AFT  l  1 

DF 

E ST  1  MATE 

ERROR 

T  RATIO 

PROB> | r I 

INILKCE  PI 

1 

0.882353 

0.007255864 

121 .6055 

0 . 0001 

COl  OK 

1 

-0. 148363 

0.024572 

-6.0380 

0 . 000  1 

MODfl:  MODEL  3  1 

SSE 

259. 708068 

F  RATIO 

13.  70 

DTE 

2324 

PROB>  F 

0 . 000 1 

DEP  VAR:  U 

MSE 

0.111 750 

R-SQUARE 

0.01 74 

PARAMETER 

STANDARD 

VARIABLE 

DF 

LST 1  MAI  E 

ERROR 

T  RATIO 

PROB> 1 1 1 

IN  IF  KCF  PI 

1 

0. 127130 

0.00855751 

14.8559 

0 . QUO  1 

SO 

1 

-0.033641 

0.016118 

-2.0871 

0.03  70 

COl  OK 

1 

0. 153358 

0.03 7899 

4.0469 

0.000  1 

1  NIRACT 

1 

0.009351145 

0.050459 

0.  1853 

0.8530 

MODEl  :  MODEL 32 

SSE 

259. 708068 

F  RATIO 

13.  70 

DTE 

2324 

PROB>T 

0.0001 

DEP  VAR:  M 

MSE 

0.111 750 

R-SQUARE 

0.0174 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> | T | 

1  NTERCCPT 

1 

0.872870 

0.00855751 

102.0005 

0.00O1 

so 

1 

0.033641 

0.016118 

2.0871 

0.0370 

COLOR 

1 

-0. 153358 

0.037895 

-4.0469 

0.0001 

INTRACT 

1 

-0.00935114 

0.050459 

-0. 1853 

0.8530 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate 
0.1  percent  subsample. 
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TABLE  9(c)  Linear  Probability  Models:  Civilian,  Student  Female  Teenagers 


MODEL:  MODEL01 

SSE 

21  1  .  346319 

F  RATIO 

3.77 

DFE 

5683 

PROB>F 

0.0524 

DEP  VAR:  U 

MSE 

0.037189 

R-SQUARE 

0.0007 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> 1 T  1 

1  NT ERCEPT 

1 

0.036583 

0.002780295 

13.1579 

0.0001 

COLOR 

1 

0.013760 

0.007090884 

1.9406 

0.0524 

MODEL:  MODE  L02 

SSE 

1256.516 

F  RATIO 

155.97 

DFE 

5683 

PROB>  F 

0.0001 

f)f  P  VAR:  M 

MSE 

0.221 101 

R-SQUARE 

0.0267 

VAR  1  ABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> 1 T | 

INTERCEPT 

1 

0.381833 

0.006779186 

56.3244 

0.0001 

COLOR 

1 

-0.215929 

0.017290 

-12.4889 

0.0001 

MODEL:  MODEL03 

SSE 

1318.858 

F  RATIO 

130.26 

DFE 

5683 

PROB>  F 

0.0001 

HEP  VAR:  N 

MSE 

0.232071 

R-SQUARE 

0.0224 

VARIABLE 

DF 

ESTIMA1 E 

ERROR 

T  RATIO 

PROB> | T  I 

1  NT  ERCEPT 

1 

0.581584 

0.006945323 

83.7375 

0.0001 

COLOR 

1 

0.202169 

0.017713 

11.4133 

0.0001 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate 
0.1  percent  subsample. 


TABLE  9(d)  Linear  Probability  Models:  Civilian,  Student  Labor  Force 
Participants,  Female  Teenagers 


MODEL: 

MODEL21 

SSE 

194.368636 

F  RATIO 

41 . 33 

DFE 

2200 

PROB>F 

0.0001 

DTP  VAR: 

U 

MSE 

0.088349 

R-SQUARE 

0.0184 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> | T | 

1  N 1 ERCEPT 

1 

0.087432 

0.006624908 

13. 1974 

0.0001 

COLOR 

1 

0. 145373 

0.022613 

6.4287 

0.0001 

MODEL: 

MOOT  L22 

SSE 

194.368636 

F  RATIO 

41 . 33 

DFE 

2200 

PR0B>  F 

0.0001 

Dl P  VAR: 

M 

MSE 

0.088349 

R-SQUARE 

0.0184 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PR0B> | T  I 

1  N  1  ERCEPT 

1 

0.912568 

0.006624908 

137.7481 

0.0001 

COLOR 

1 

-0.145373 

0.022613 

-6.4287 

0.0001 

MODEL : 

MODFL31 

SSE 

194.338377 

F  RATIO 

13.88 

DFE 

2198 

PR0B>  F 

0.0001 

Df  P  VAR: 

U 

MSE 

0.088416 

R-SQUARE 

0.0186 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PROB> I T | 

1  NT ERCEPT 

1 

0.089833 

0.007846721 

11 .4485 

0.0001 

SO 

1 

-0.00837706 

0.014656 

-0.5716 

0.5677 

COLOR 

1 

0. 140052 

0.032831 

4.2659 

0.0001 

INTRACT 

1 

0.013786 

0.045803 

0.3010 

0. 7635 

MODEL: 

MODEL32 

SSE 

194.338377 

F  RATIO 

13.88 

DFE 

2198 

PROB>F 

0.0001 

DTP  VAR: 

M 

MSE 

0.088416 

R-SQUARE 

0.0186 

PARAMETER 

STANDARD 

VARIABLE 

DF 

ESTIMATE 

ERROR 

T  RATIO 

PR0B> | T | 

INTERCEPT 

1 

0.910167 

0.007846721 

115.9933 

0.0001 

SO 

1 

0.008377063 

0.014656 

0.5716 

0.5677 

COLOR 

1 

-0. 140052 

0.032831 

-4.2659 

0.0001 

1 N TRACT 

1 

-0.013786 

0.045803 

-0.3010 

0.7635 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate 

H  1  nprrpnt  cnhcamnle> 
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more  significant  racial  differential  of  1.38  percent  for  females. 
However,  as  was  the  case  for  nonstudents,  a  regression  for  a  sample 
restricted  to  labor  force  participants  tells  a  very  different  story. 

Table  9(b)  gives  as  the  gross  differential  between  black  and  white 
male  student  unemployment  rates  a  highly  significant  14.8  percent. 

This  difference  is  greater  than  the  white  unemployment  rate,  11.8 
percent.  When  computed  from  this  regression,  the  ratio  of  black  to 
white  student  unemployment  rates  is  2.26.  When  computed  from  Table  8 
the  ratio  is  2.02.  Once  again,  the  difference  between  the  two  computa¬ 
tions  stems  from  the  reduced  sampling  error  in  the  tenfold  larger 
sample  summarized  in  the  earlier  table.  "MODEL31"  shows  that,  once 
again,  the  racial  differential  is  larger  outside  the  South  than  in  the 
South. 

Part  (d)  of  Table  9  shows  a  gross  female  student  racial  unemployment 
differential  that  is  very  close  to  the  male  differential;  it  is  14.5 
percent  and  highly  significant.  "MODEL31"  shows  something  different 
for  women,  however.  The  implied  ratios  of  black  to  white  student 
unemployment  rates  are  2.89  in  the  South  and  2.56  outside  the  South. 

For  men,  the  ratio  was  larger  outside  the  South. 


Effect  of  Additional  Explanatory  Variables 

Tables  10  (a) -10(d)  show  the  same  equations  for  students  that  were 
estimated  for  nonstudents  in  Table  6.  There  are  two  dramatic  changes. 
First,  for  male  students  but  not  for  female  students,  race  loses  its 
significant  effect  entirely,  regardless  of  whether  age  is  included. 
Second,  for  male  students  but  not  for  female  students,  household 
income,  net  of  the  teenager's  earnings,  emerges  from  insignificance  as 
a  strong  explainer  of  variation  in  unemployment.  When  age  is  included 
in  the  equation,  household  income  is  the  greatest  reducer  of  chi-square 
for  young  men,  stronger  even  than  education. 


SUMMARY 

This  paper  presented  a  very  brief  review  of  the  economic  literature 
on  unemployment,  in  particular  the  implications  for  empirical  work  on 
youth  unemployment  and  labor  force  participation.  New  structural  models 
for  use  with  microdata  were  developed.  These  models  may  reduce  two 
important  sources  of  bias  in  estimates  of  the  impact  of  race  on 
unemployment:  simultaneity  and  ecological  correlation. 

Original  empirical  work  based  on  1980  Census  microdata  shows,  using 
simple,  single-equation  methods,  that  the  labor  force  participation 
decision  cannot  be  ignored  in  estimating  the  impact  of  race  on 
unemployment.  For  students  and  nonstudents,  male  and  female,  there  is 
no  gross  racial  differential  to  be  explained  if  unemployment  is  measured 
as  the  ratio  of  the  number  of  unemployed  to  the  size  of  the  population. 
However,  when  samples  are  restricted  to  labor  force  participants,  large 
and  significant  racial  differentials  emerge.  These  racial  differentials 
vary  by  sex,  region,  and  school  enrollment  status.  A  racial  difference 
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TABLE  10(a)  Conditional  Employment  Probabilities  Using  Age  as  a  Regressor, 
Civilian,  Student  Labor  Force  Participants,  Male  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2328  OBSERVATIONS 
304  POSITIVES 
2024  NEGATIVES 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


•2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  1804.18 


CONVERGENCE  OBTAINED  IN 

6  ITERATIONS. 

D=0 . 

031  . 

MAX  ABSOLUTE  DERIVATIVE 

=0 . 4640D-05 . 

-2  LOG 

:  L=  1731 

.04. 

MODEL  CHI 

1  - SQUARE=  73. 

14  WITH  10  D. F. 

~D 

11 

O 

O 

VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE 

p 

D 

1 NTERCEPT 

1.76678657 

1 .17332444 

2.27 

0.1321 

EDUCATN 

-0. 12846921 

0.06282174 

4.  18 

0.0409 

0.002 

AGE 

-0.10924862 

0.08495874 

1.65 

0. 1985 

0.001 

HH 1 NCOME 

-0.01426909 

0.00428306 

11.10 

0.0009 

0.005 

FAM 

-0. 1 1351487 

0.77743107 

0.02 

0.8839 

0.000 

DISABIL 

0.94116955 

0.36656585 

6.59 

0.0102 

0.003 

SO 

-0.3892022 8 

0. 16154140 

5.80 

0.0160 

0.002 

CC 

-0.20908409 

0.17225555 

1.47 

0.2248 

0.001 

SOXCOL 

0.46637668 

0.38838368 

1 . 44 

0.2298 

0.001 

CCXCOL 

0.92305443 

0.39506808 

5.46 

0.0195 

0.002 

COLOR 

0.24863929 

0.39256550 

0.40 

0.5265 

0.000 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C”  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  10(b)  Conditional  Employment  Probabilities,  Civilian,  Student  Labor  Force 
Participants,  Male  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2328  OBSERVATIONS 
304  POSITIVES 
2024  NEGATIVES 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  0NLY=  1804.18 


CONVERGENCE  OBTAI 

NED 

IN  6 

ITERATIONS. 

D--0 . 030 

MAX  ABSOLUTE  DERI 

VAT 

1 VE=0. 

2649D-05 . 

-2  LOG  L=  1732.72 

MODEL  CH 1 -SQUARE= 

71.46 

WITH  9  D. F . 

P=0.0 

VAR  1  ABLE 

BETA 

STD.  ERROR 

CHI -SQUARE 

P 

D 

INTERCEPT 

0.40037328 

0.50537597 

0.63 

0.4282 

EDUCATN 

-0. 18290315 

0.04526800 

16.33 

0.0001 

0.00  7 

HH 1 NCOME 

-0.01358426 

0.00422821 

10.32 

0 . 00  1  3 

0.004 

TAM 

-0. 19656901 

0. 77373926 

0.06 

0.7995 

0.000 

DISABIL 

0.92588989 

0.36581134 

6.41 

0.0114 

0.00  3 

SO 

-0.38803809 

0. 16150578 

5.77 

0.0163 

0.002 

CC 

-0.21812070 

0. 1 7209600 

1.61 

0. 2050 

0.001 

SOXCOL 

0.44365482 

0. 38765566 

1.31 

0.2524 

0.001 

CCXCOL 

0.91135256 

0.39467425 

5.  33 

0.0209 

0 . 002 

COLOR 

0.25223778 

0.39166524 

0.41 

0.5196 

0.000 

SOURCE:  Bureau  of  the  Census, 

"Public-Use  Microdata  Sample  C"  (Washington,  D.C.: 

U.S. 

Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 


percent  subsample. 
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TABLE  10(c)  Conditional  Employment  Probabilities  Using  Age  as  a  Regressor, 
Civilian,  Student  Labor  Force  Participants,  Female  Teenagers 


LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2202  OBSERVATIONS 
1982  U  =  0 

220  U  =  1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  1430.79 


MODEL 

CH 1  -  SQUARE^  61.55 

WITH  10  0. F. 

(SCORE  STAT 

C 

O 

II 

Q- 

CONVERGENCE  OB  1 A  1  NED  IN  6 

ITERATIONS. 

R=  0. 

147! 

MAX  ABSOLUTE  DER 1 VA  f 1 VE=0. 

1 323D-1 1 . 

-2  LOG 

;  L=  1379 

.95. 

MODEL 

CH 1 -SQUARE=  50.84 

WITH  10  D. F. 

(-2  LOG  L.R 

. )  P=0.0000. 

VARIABLE 

BETA 

STD.  ERROR 

CHI-SQUARE 

P 

R 

1 NTERCEPT 

1.75277707 

1 . 39271281 

1.58 

0.2082 

EDUCATN 

-0.07694844 

0.09504671 

0.66 

0.4182 

0.000 

AGE 

-0. 18154598 

0.11397084 

2.54 

0.1112 

-0.019 

HH INCOME 

-0.00251025 

0.00444995 

0.32 

0.5727 

0.000 

FAM 

0.20474210 

0.45725416 

0.20 

0.6543 

0.000 

DISABIL 

1 . 04000882 

0.47274892 

4.84 

0.0278 

0.045 

SO 

-0. 10730316 

0. 17961398 

0.36 

0.5502 

0.000 

CC 

0.05299589 

0. 18402893 

0.08 

0.7734 

0.000 

SOXCOL 

0.15040473 

0.40052623 

0.14 

0.7073 

0.000 

CCXCOL 

-0.44346755 

0.40144515 

1 .22 

0.2693 

0.000 

COLOR 

1.40902455 

0.36442253 

14.95 

0.0001 

0.095 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 


TABLE  10(d)  Conditional  Employment  Probabilities,  Civilian,  Student  Labor 
Force  Participants,  Female  Teenagers 

LOGISTIC  REGRESSION  PROCEDURE 
DEPENDENT  VARIABLE:  U 


2202  OBSERVATIONS 
1982  U  =  0 

220  U  =1 

0  OBSERVATIONS  DELETED  DUE  TO  MISSING  VALUES 


-2  LOG  LIKELIHOOD  FOR  MODEL  CONTAINING  INTERCEPT  ONLY=  1430.79 


MODEL  CHI 

-SQUARE^  59. 

45  Wl TH  9  D. F. 

(SCORE  STAT 

O 

O 

II 

0- 

CONVERGENCE  OBTAINED 

IN 

6  ITERATIONS. 

R=  0. 

145! 

MAX  ABSOLUTE  DERIVAT 

IVE 

=  0.0 

-2  LOG 

L=  1382 

.65. 

MODEL  CHI 

-SQUARE=  48. 

14  Wl TH  9  D. F. 

(-2  LOG  L.R 

.)  P=0.0000. 

VARIABLE 

BETA 

STD.  ERROR 

CHI -SQUAR'D 

P 

R 

1 NTERCEPT 

-0.25593762 

0.64135974 

0.16 

0.6899 

EDUCATN 

-0. 18882782 

0.05732037 

10.85 

0.0010 

-0.079 

HH INCOME 

-0.00182823 

0.00440851 

0.17 

0.6784 

0.000 

FAM 

0. 17669396 

0.45545650 

0.15 

0.6981 

0.000 

DISABIL 

0.99716482 

0.47069812 

4.49 

0.0341 

0.042 

SO 

-0. 12178188 

0.17983748 

0.46 

0.4983 

0.000 

CC 

0.03780462 

0.18384286 

0.04 

0.8371 

0.000 

SOXCOL 

0.1 1184032 

0.39910105 

0.08 

0.7793 

0 . 000 

CCXCOL 

-0.45539480 

0.40061771 

1 .29 

0.2557 

0.000 

COLOR 

1.41227175 

0.36298837 

15.  14 

0.0001 

0.096 

SOURCE:  Bureau  of  the  Census,  "Public-Use  Microdata  Sample  C"  (Washington,  D.C.:  U.S. 
Department  of  Commerce,  1983):  blacks,  noninmate  1  percent  sample;  whites,  noninmate  0.1 
percent  subsample. 
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in  labor  force  participation  tends  in  each  case  to  offset  almost  com¬ 
pletely  the  racial  difference  in  the  unemployment  rate,  so  that  there 
are  no  significant  differences  in  unemployment-population  ratios  by 
race.  Two  very  different  structural  interpretations  of  these  findings 
are  higher  reservation  wages  for  blacks  and  discouraged-worker  effects. 
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Hispanic  Youth  in  the  Labor  Market: 
An  Analysis  of  High  School  and  Beyond 

Roberto  Fernandez 


INTRODUCTION 

The  number  of  people  of  Spanish  origin  in  the  United  States  rose 
from  9.1  million  in  1970  to  14.6  million  in  1980  (Bureau  of  the  Census, 
1982 :Table  3.2).  In  addition  to  this  growth  in  absolute  numbers,  the 
relative  share  of  the  population  accounted  for  by  Hispanics  grew  from 
4.5  percent  in  1970  to  6.4  percent  in  1980.  Although  part  of  these 
increases  probably  reflect  changes  in  Census  Bureau  enumeration 
procedures  (see  Jaffe  et  al.,  1980:311-313  and  Appendix  A)  and  an 
undercount  of  Hispanics  in  1970  (Bureau  of  the  Census,  1979a;  U.S. 
Commission  on  Civil  Rights,  1974)  ,  it  is  clear  that  Hispanics  are  a 
substantial  and  growing  part  of  the  population  of  the  United  States. 

Hispanics  tend  to  be  younger  than  non-Hispanic  whites.  According 
to  the  March  1977  Current  Population  Survey,  the  median  age  of  the 
Spanish-origin  population  was  22.1  years  versus  30.0  for  non-Hispanic 
whites  (Bureau  of  the  Census,  1979b:Table  C)  .  Since  Hispanics  are 
disproportionately  young,  they  are  more  likely  than  non-Hispanic  whites 
to  suffer  the  employment  problems  that  youth  in  general  face  in  the 
labor  market,  e.g.,  low  employment  and  low  labor  force  participation 
rates.  In  fact,  the  data  show  that  regardless  of  age,  rates  of 
employment  and  labor  force  participation  are  lower  for  Hispanics  than 
for  non-Hispanic  whites,  but  not  as  low  as  for  native  Americans  or 
non-Hispanic  blacks  (U.S.  Commission  on  Civil  Rights,  1978:Table  3.1). 
However,  differences  in  population-age  profiles  cannot  explain  why 
Hispanic  youths  are  less  successful  than  white  majority  youths  in  the 
labor  market.  For  example,  among  those  aged  16-19  in  1981,  Hispanics 
had  an  unemployment  rate  of  24.1  percent  and  a  civilian  labor  force 
participation  rate  of  46.3  percent  compared  with  17.3  and  59.0  percent, 
respectively,  for  whites  and  41.5  and  37.4  percent,  respectively,  for 
blacks  (National  Commission  for  Employment  Policy,  1982:Table  1) .  Data 
from  the  March  1980  Current  Population  Survey  show  that  Hispanic  youths 
encounter  other  barriers  in  the  labor  market,  as  well.  Among  those 
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aged  14-19,  Hispanics  performed  worse  than  non-Hispanic  whites  and 
blacks  on  three  out  of  four  indicators  of  "underemployment,”  i.e., 
Hispanic  youths  are  more  likely  to  experience  involuntary  part-time 
employment,  live  in  households  whose  incomes  fall  below  the  poverty 
line,  and  receive  inequitable  pay  than  are  non-Hispanic  whites  and 
blacks,  although  blacks  are  more  likely  than  Hispanics  to  be  inter¬ 
mittently  employed  (U.S.  Commission  on  Civil  Rights,  1982:Table  5.4; 
also  see  Clogg,  1979;  Sullivan,  1979). 

While  it  is  clear  that  Hispanic  youths  are  less  successful  than 
non-Hispanic  whites  in  the  labor  market,  the  reasons  underlying  these 
disadvantages  are  less  obvious.  Determining  the  causes  of  Hispanic 
underachievement  has  important  practical  implications;  the  choice  of 
relevant  policies  to  ameliorate  those  conditions  depends  on  under¬ 
standing  the  factors  that  lead  Hispanics  to  fare  less  well  than 
non-Hispanic  whites  in  the  labor  market. 

In  this  paper,  I  undertake  two  tasks.  First,  I  document  the  extent 
of  the  employment  difficulties  of  Hispanics  compared  with  non-Hispanic 
whites  and  blacks  using  data  from  High  School  and  Beyond,  a  national 
longitudinal  study  of  high  school  sophomores  and  seniors  in  1980. 

Because  respondents  in  this  survey  were  enrolled  in  school  in  1980, 
labor  force  statistics  derived  from  the  survey  will  not  be  directly 
comparable  with  statistics  based  on  household  surveys  of  the  labor 
force,  e.g.,  the  Current  Population  Surveys.  However,  because 
respondents  in  High  School  and  Beyond  all  started  in  high  school,  the 
survey  is  ideal  for  studying  the  transition  of  youths  from  school  to 
work.  Although  past  research  has  found  that  Hispanic  youths  fare  less 
well  than  non-Hispanic  white  youths  on  many  indicators  of  labor  market 
success  (e.g.,  wages,  family  income;  see  Mayers,  1980),  I  will  focus  on 
two  important  measures,  i.e.,  labor  force  participation  and  unemployment 
rates.  Also,  because  of  the  interdependency  between  youths'  leaving 
school  and  their  employment  decisions  during  the  school-to-work  transi¬ 
tion  (see  National  Commission  for  Manpower  Policy,  1976;  Stevenson, 
1978b),  I  discuss  the  indicators  of  labor  force  status  by  school  status, 
i.e.,  by  high  school  dropout  versus  in-school  youths  for  the  sophomore 
cohort,  and  by  out-of-school  versus  attending  postsecondary  institution 
for  the  senior  cohort. 

My  second  task  is  to  examine  some  of  the  presumed  causes  of  the 
difficulties  of  Hispanic  youths  in  the  labor  market.  As  with  the 
descriptive  analyses,  labor  force  status  will  be  studied  in  conjunction 
with  school  enrollment.  Therefore,  as  a  dependent  variable,  labor 
force  participation  has  four  categories;  participating  in  the  labor 
force  and  enrolled  in  school,  participating  in  the  labor  force  and  out 
of  school,  out  of  the  labor  force  and  enrolled  in  school,  and  out  of 
the  labor  force  and  out  of  school.  Employment  status  is  treated  simi¬ 
larly  and  also  has  four  categories;  employed  and  enrolled  in  school, 
unemployed  and  enrolled,  employed  and  out  of  school,  and  unemployed  and 
out  of  school.  Using  logistic  regression  analysis,  I  predict  these 
labor  force  and  enrollment  status  indicators  with  measures  of  family 
background,  school  performance,  language,  immigration  history,  and 
other  demographic  variables. 
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The  remainder  of  this  paper  addresses  six  topics:  (1)  the  e 
knowledge  on  the  labor  market  status  of  Hispanic  youth,  (2)  the 
acteristics  of  the  High  School  and  Beyond  data  set  and  the  advan 
of  using  this  survey  for  studying  Hispanic  youths'  achievement, 
findings  of  descriptive  analyses  of  the  various  subpopulations  u 
study,  (4)  the  findings  of  causal  analyses  of  labor  force  and  en 
ment  status  indicators,  (5)  the  results  of  empirical  analyses  of 
force  participation  and  employment,  and  (6)  recommendations  for 
to  improve  the  status  of  Hispanic  youths  in  the  labor  market. 


LABOR  MARKET  STATUS  OF  HISPANIC  YOUTHS 

As  the  Hispanic  share  of  the  population  has  increased,  the  s< 
economic  achievement  of  Hispanics  has  increasingly  become  the  ob 
policy  discussion  (see  e.g.,  National  Center  for  Education  Stati 
1980;  National  Commission  for  Employment  Policy,  1982) .  Unfortun 
research  on  Hispanics  in  general,  and  Hispanic  youths  in  particu 
has  been  hampered  by  a  lack  of  suitable  data  (see  Estrada,  1980) 
this  reason,  information  on  the  labor  market  status  of  Hispanic 
is  poor  relative  to  that  available  on  non-Hispanic  white  and  bla 
youths  (see,  e.g..  Freeman  and  Wise,  1982). 

Because  much  research  suggests  that  the  decisions  young  peop 
on  participating  in  the  labor  force  and  continuing  in  school  are 
interdependent  (see  B.  Duncan,  1965;  Edwards,  1976;  Ornstein,  19 
is  important  to  examine  the  causes  of  Hispanics'  educational  dif 
ties  when  considering  the  determinants  of  their  underachievement 
labor  market.  These  causes  can  be  divided  into  two  types:  gene 
specific.  General  factors,  such  as  sex  and  family  socioeconomic 
are  potentially  important  for  explaining  the  school  and  labor  ma 
achievements  of  everyone  in  the  United  States,  regardless  of  the 
or  ethnicity.  Specific  factors  are  characteristics  that  are  par 
larly  salient  for  some  minority  groups  and  are  expected  to  affec 
groups  disproportionately.  For  Hispanics,  specific  factors  are 
language  skills  and  immigration  history. 

Distinguishing  between  the  effects  of  general  and  specific  f 
on  the  labor  market  achievements  of  Hispanics  is  important  for  p 
purposes.  For  example,  if  Hispanics'  labor  market  disadvantages 
primarily  to  their  lower  levels  of  family  socioeconomic  status, 
general  policies  designed  to  help  all  poor  people  would  help  imp 
Hispanics'  labor  market  status.  However,  if  specific  factors,  s 
language  background,  account  for  a  large  portion  of  Hispanics'  s 
or  labor  market  difficulties,  then  general  policies  are  apt  to  d 
little  to  improve  Hispanics'  performance  in  school  or  in  the  lab 
market.  In  this  case,  policy  instruments,  such  as  bilingual  edu 
may  have  to  be  targeted  specifically  on  the  Hispanic  population 
improve  Hispanics'  labor  market  achievements. 


General  Factors 


Recent  studies  identify  Hispanics'  low  levels  of  education  as  one 
of  the  most  important  general  factors  that  explain  Hispanic  youths' 
underachievement  in  the  labor  market  (National  Commission  for  Employment 
Policy,  1982) .  Indeed,  there  is  much  evidence  that  Hispanics  experience 
considerable  educational  difficulties.  At  each  age  level,  school 
enrollment  rates  for  Hispanics  lag  those  for  whites  (National  Center 
for  Education  Statistics,  1980:Table  1.08) .  Hispanics  also  have 
significantly  lower  rates  of  high  school  completion  than  non-Hispanic 
whites  (National  Center  for  Education  Statistics,  1980:Table  1.09). 

Among  those  who  remain  in  school,  Hispanics  are  much  more  likely  to 
have  to  repeat  a  grade  as  they  progress  through  school  than  non- 
Hispanic  whites  (National  Center  for  Education  Statistics,  1980: Table 
2.21).  Hispanic  educational  difficulties  extend  to  the  postsecondary 
level,  as  well.  Hispanics  are  underrepresented  in  undergraduate, 
graduate,  and  professional  programs  relative  to  their  share  of  the 
population  (National  Center  for  Education  Statistics,  1980:Table  3.01) 
and  underrepresented  among  the  nation's  degree  recipients  (National 
Center  for  Education  Statistics,  1980:Table  3.21). 

There  is  much  research,  however,  that  suggests  that  these  educa¬ 
tional  difficulties  are,  in  turn,  caused  by  other  general  factors.  In 
other  words,  Hispanics'  low  levels  of  education  are  an  endogenous  cause 
of  their  labor  market  difficulties.  Other  factors  that  influence 
Hispanics'  educational  attainments  may  also  influence  their  labor 
market  achievements  directly,  or  indirectly  through  educational  attain¬ 
ment.  The  most  important  of  these  factors  is  family  socioeconomic 
background  (Blau  and  Duncan,  1967;  0.  Duncan  et  al.,  1972;  Jencks  et 
al.,  1972).  This  is  generally  interpreted  to  mean  that  higher  income 
families,  in  which  parents  have  high  educational  and  occupational 
statuses,  are  more  likely  to  support  their  children  in  educational 
endeavors.  Less  affluent  families  may  not  emphasize  education  for 
their  children  as  much  because  the  relative  cost  of  college  and  higher 
education  relative  to  the  prospective  returns  on  this  investment  do  not 
justify  the  expenditure. 

In  addition  to  the  indirect  effects  of  family  background  on  labor 
market  outcomes  through  education,  most  studies  have  also  shown  direct 
effects  of  family  background  on  offsprings'  labor  market  success  (e.g., 
Blau  and  Duncan,  1967)  .  Unfortunately,  the  mechanisms  by  which  these 
direct  effects  operate  are  not  well  understood  in  the  case  of  occupa¬ 
tional  status  and  earnings.  A  number  of  complicated  and  sometimes 
crosscutting  processes  appear  to  be  operating  to  convert  family 
background  into  occupational  status  and  earnings  (see  Jencks  et  al. , 
1979:Ch.  3).  However,  in  the  case  of  youths'  labor  force  participation 
and  employment,  it  has  been  shown  that  children  of  poorer  families  are 
likely  to  enter  the  labor  force  at  earlier  ages  than  offspring  of 
wealthier  families  (Neugarten  and  Hagestad,  1976) ,  even  after  the 
effects  of  educational  attainment  are  controlled  (Hogan,  1981:Ch.  5). 

The  direct  effects  of  family  background  on  labor  force  participation 
and  employment  have  also  been  documented  for  high  school  students 
(Lewin-Epstein,  1981)  . 
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However ,  when  considering  Hispanic  immigrants  specifically,  < 
(e.g.,  Featherman  and  Hauser,  1978;  Borjas,  1982;  Tienda,  1983) 
that  Hispanic  immigrants  are  at  a  socioeconomic  disadvantage  (re 
to  long-time  residents),  which  these  researchers  attribute  to  di 
f iculties  of  language,  cultural  adjustment,  and  transferability  < 
skills.  In  addition,  using  census  data,  Jaffe  et  al.  (1980)  hav 
that  Hispanic  immigrants  have  lower  levels  of  education  than  oth 
immigrants,  which  can  result,  through  the  general  mechanisms  des 
above,  in  lower  educational  and  occupational  achievements  for 
themselves  and  their  children. 

In  addition  to  the  above  research,  which  focuses  on  the  char 
tics  of  immigrants  that  lead  them  to  achieve  well  or  poorly  in  t 
United  States,  a  number  of  researchers  have  emphasized  that  the 
political  and  economic  climate  of  the  United  States  at  the  time 
immigration  may  be  an  important  determinant  of  how  well  and  how 
immigrants  are  assimilated.  The  Cubans  are  an  example  here.  It 
been  argued  that  the  particular  historical  circumstances  under  w 
the  initial  wave  of  Cuban  immigration  took  place — the  climate  of 
general  acceptance  by  the  host  population,  the  legal  status  of  C 
as  political  rather  than  economic  migrants  (Pedraza-Bailey ,  1980 
Wilson  and  Portes,  1980),  and  supportive  governmental  policies  a 
time  of  Cuban  settlement  (see,  Rogg ,  1974;  Pedraza-Bailey  and  Su 
1979;  Sullivan  and  Pedraza-Bailey,  1979;  Jorge  and  Moncarz,  1980 
explain  Cubans'  relative  advantage  over  other  Hispanic  subgroups 
e.g.,  Borjas,  1982;  Nielsen  and  Fernandez,  1982;  Portes,  1982). 
number  of  researchers  have  also  argued  that  the  fact  that  Cuban 
immigrants  have  largely  settled  in  an  ethnic  enclave  (Miami)  mad 
previous  immigrants  (see  Wilson  and  Portes,  1980;  Wilson  and  Mar 
1982)  who  own  about  10  percent  of  the  businesses  and  employ  50  p 
of  Cuban  males  in  the  area  (see  Clark,  1977;  Portes  et  al.,  1977 
has  had  beneficial  effects  on  Cubans'  socioeconomic  achievements 
Portes  and  Bach,  1980;  Portes,  1982). 

Finally,  there  is  a  substantial  literature  that  suggests  the 
ethnicity,  viewed  as  analytically  separable  from  language  and  iir 
tion  factors,  is  related  to  lower  achievement  among  Hispanics.  ,? 
arguments  regarding  the  disadvantages  that  blacks  face,  it  is  of 
argued  that  racial-ethnic  prejudice  or  cultural  and  socializatic 
differences  between  majority-minority  groups  help  to  explain  ach 
differentials  (see,  e.g..  Carter  and  Segura,  1979;  Noboa,  1980; 
review,  see  Duran,  1983).  Although  measuring  the  effects  of  rac 
cultural  discrimination  in  school  or  in  the  workplace  is  extreme 
difficult,  discrimination  is  often  cited  as  a  major  reason  for  E 
youths'  school  and  labor  market  difficulties  (see  Carter  and  Sec 
1979;  National  Commission  for  Employment  Policy,  1982).  In  the 
labor  market  discrimination,  inferences  have  been  made  on  the  be 
the  different  earnings  returns  to  education  for  whites  and  Hispc 
(National  Commission  for  Employment  Policy,  1982)  .  Such  Hispan] 
differentials  in  returns  to  education  have  also  been  offered  as 
reason  for  Hispanic  youths'  lower  levels  of  schooling:  Hispanic 
are  less  likely  to  judge  each  additional  year  of  schooling  to  b« 
the  investment,  and  hence,  they  are  more  likely  to  drop  out. 


DATA  AND  VARIABLES 


The  High  School  and  Beyond  Data  Base 

The  data  analyzed  in  this  paper  are  from  the  first  two  waves  (1980 
and  1982)  of  the  National  Center  for  Education  Statistics  (NCES)  study. 
High  School  and  Beyond,  a  longitudinal  study  of  U.S.  high  school 
sophomores  and  seniors  in  1980.  The  data  were  collected  for  NCES  by 
the  National  Opinion  Research  Center  at  the  University  of  Chicago.  The 
base-year  (1980)  sample  consists  of  30,030  sophomores  and  28,240  seniors 
in  1,015  high  schools;  the  overall  response  rate  of  84  percent.  Of  the 
respondents,  25,875  sophomores  and  10,815  seniors  were  surveyed  again 
in  1982.  Hispanic  schools  were  over sampled  in  the  base  year,  and 
respondents  in  those  schools  had  very  high  probabilities  of  being 
included  in  the  follow-up  sample  (see  Frankel  et  al.,  1981). 

Three  features  of  High  School  and  Beyond  make  it  ideal  for  studying 
Hispanic  youths’  labor  market  achievements.  First,  because  it  is  a 
longitudinal  study  of  the  sophomore  and  senior  high  school  classes  in 
1980,  respondents  can  be  tracked  through  their  transition  from  school 
to  work.  In  addition  to  providing  information  on  respondents'  labor 
force  status,  the  study  provides  detailed  data  on  respondents' 
educational  backgrounds  and  on  how  respondents  combine  their  school  and 
labor  force  activities. 

Second,  because  Hispanics  were  over sampled,  the  study  contains 
sufficient  numbers  of  Cubans,  Puerto  Ricans,  and  Mexican-Americans  for 
separate  analyses.  This  is  important  because  past  research  has  shown 
that  Hispanic  subgroups  differ  in  their  school  and  labor  market 
achievement  profiles  (Newman,  1978;  Jaffe  et  al.,  1980;  National  Center 
for  Education  Statistics,  1980;  National  Commission  for  Employment 
Policy,  1982;  Nielsen  and  Fernandez,  1982) . 

Third,  High  School  and  Beyond  is  rare  in  that  it  includes  many 
detailed  questions  about  the  linguistic  practices  of  the  respondent  and 
his  or  her  family  (see  Nielsen,  1980 :App.  B  and  C,  for  descriptions  and 
discussions  of  the  language  data  available  from  the  survey) .  The  study 
also  provides  information  especially  relevant  to  Hispanics,  such  as 
nativity  and  length  of  U.S.  residence. 


Definition  of  Comparison  Groups 

One  of  the  main  goals  of  this  paper  is  to  provide  statistics 
showing  how  Hispanic  youths  compare  with  non-Hispanic  youths  on 
different  measures  of  employment  status.  To  this  end,  I  have  divided 
both  the  sophomore  and  senior  samples  into  groups  of  Hispanics, 
non-Hispanic  whites,  and  non-Hispanic  blacks. 

Self-identification  was  used  in  the  survey  to  classify  respondents' 
ethnic  identity.1  This  was  done  for  both  theoretical  and  practical 


detailed  coding  information  on  the  definition  of  the  comparison 
groups  and  both  the  dependent  and  independent  variables  can  be  found  in 
the  appendix. 
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reasons.  First,  the  use  of  self-identification  to  define  ethni 
identification  is  in  agreement  with  the  emerging  theoretical  co 
on  what  constitutes  "ethnic"  identity  (Barth,  1969).  Second,  s 
identification  of  ethnicity  is  particularly  well  suited  for  use 
surveys.  Smith  (1980)  has  shown  that  of  the  various  methods  of 
classification  (i.e.,  natal  definitions,  such  as  those  based  on 
respondent's  country  of  birth;  behavioral  definitions  based  on 
objective  cultural  criterion,  such  as  the  use  of  a  language  oth 
English;  and  subjective  criteria  involving  self-identification 
respondent) ,  self-identification  is  the  most  efficient  techniqu 
eliciting  a  positive  national-origin  identification  from  respon 
the  general  population.  (Also  see  Smith,  1983;  for  research  re 
the  identification  of  Mexican-Americans ,  see  Hernandez  et  al. , 


Dependent  Variables 

Two  dependent  variables  are  analyzed:  labor  force  particip 
and  unemployment.  For  both  variables,  the  statistics  reported 
those  in  the  civilian  labor  force;  those  enlisted  in  the  milita 
counted  as  out  of  the  labor  force.  Because  school-leaving  and 
ment  decisions  are  interdependent,  I  treat  labor  force  and  scho 
status  as  simultaneous  events.  Therefore,  for  both  sophomores 
seniors,  the  two  dependent  variables  each  have  four  categories, 
labor  force  participation,  the  four  categories  for  sophomores  a 
participating  in  the  labor  force  and  enrolled  in  high  school;  p 
pating  in  the  labor  force  and  not  enrolled  in  high  school;  out 
labor  force  and  enrolled  in  school;  out  of  the  labor  force  and 
enrolled  in  school.  The  variable  is  defined  similarly  for  seni 
the  exception  that  the  relevant  school-continuation  decision  is 
i.e.,  enrollment  in  postsecondary  education  rather  than  enrolle 
not  enrolled  in  high  school.  The  unemployment  variable  is  defi 
analogous  fashion  for  both  cohorts,  i.e.,  among  those  participa 
the  labor  force,  respondents  were  distinguished  as  employed  ver 
unemployed  and  enrolled  in  school  versus  not  enrolled. 


Independent  Variables 

Corresponding  to  the  discussion  in  the  literature  review  se 
the  independent  variables  are  divided  into  two  groups:  general 
specific.  Among  the  general  predictors  of  labor  force  and  schc 
enrollment  status  are  family  socioeconomic  background,  scholast 
performance,  demographic  variables,  and  a  measure  of  past  labor 
involvement. 


For  both  sophomores  and  seniors,  I  measured  family  socioeconomic 
background  with  a  composite  variable  derived  from  a  number  of  measures 
of  parental  background  and  family  resources.2 

To  assess  the  effects  of  scholastic  performance  on  school  retention 
and  employment  propensity,  I  also  included  among  the  general  predictors 
of  labor  force  and  school  enrollment  status  two  measures  of  scholastic 
achievement:  self-reported  grades  and  a  standardized-test  composite. 

As  measures  of  scholastic  achievement,  grades  and  test  scores  differ  in 
that  grades  do  not  vary  across  schools,  while  test  scores  vary  both 
within  and  between  schools. 

Three  demographic  variables  are  also  included  as  general  predictors 
sex,  age,  and  marital  status.  Respondents’  sex  is  measured  by  a  dummy 
variable  coded  1  =  male  and  0  =  female.  Because  younger  respondents 
are  expected  to  be  less  likely  to  participate  in  the  labor  force  and 
more  likely  to  be  enrolled  in  school,  I  also  included  a  measure  of  the 
respondent's  age,  coded  in  years,  in  the  models  discussed  below. 

Marital  status  was  included  as  a  demographic  variable  to  test  the 
hypothesis  that  the  increased  financial  responsibilities  that  accompany 
marriage  are  likely  to  force  respondents  into  the  labor  force. 

Finally,  to  assess  the  effects  of  past  labor  force  experience  on 
youths'  labor  force  and  enrollment  status  (see  Stevenson,  1978a),  I 
included  a  dummy  variable  measured  in  the  base-year  survey  of  past  work 
experience. 

Consistent  with  the  discussion  above,  I  also  included  six  variables 
that  are  likely  to  affect  Hispanics  disproportionately  as  predictors: 
respondent's,  father's,  and  mother's  length  of  U.S.  residence  (measured 
in  years) ;  a  dummy  variable  for  whether  the  respondent  is  bilingual; 
proficiency  in  the  non-English  language;  and  proficiency  in  English. 
(See  appendix  for  coding  details.) 

Regarding  the  language  measures,  I  considered  respondents  bilingual 
if  a  language  other  than  English  was  given  in  response  to  at  least  one 
of  three  questions:  mother  tongue  of  respondent  (first  language 
spoken) ,  second  mother  tongue  (other  language  spoken  before  schooling)  , 
respondent's  usual  language.  These  criteria  clearly  distinguish  those 
students  who  have  never  used  a  language  other  than  English  from  those 
who  have  had  at  least  some  natural  exposure  to  another  language.  Note 
that  this  is  unlike  the  criteria  used  in  the  Bilingual  Education  Act 
(as  amended  in  1974)  to  define  children  of  limited  English  proficiency 
in  that  it  does  not  hinge  on  students'  level  of  English  proficiency  or 
nativity  (see  O'Malley,  1981:Ch.  2).  My  definition  also  excludes 
respondents  with  only  indirect  contact  with  languages  other  than 
English,  such  as  those  who  studied  a  language  in  school  as  an  academic 
subject. 


Replacing  the  socioeconomc  status  composite  with  measures  of 
father's  and  mother's  education  and  family  income  does  not  change  the 
substantive  results  reported  here.  The  summary  measure  was  used 
because  of  the  large  numbers  of  missing  values  on  parental  education 
(15  to  20  percent)  and  family  income  (12  to  18  percent) . 
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The  non-English  language  proficiency  scale  used  in  the  surve 
based  on  the  student's  self-assessed  ability  to  understand,  spec 
read,  and  write  in  the  non— English  language.3  These  questions  c 
contained  in  a  separate  language  questionnaire  and  are  only  aske 
students  who  indicated  some  exposure  to  a  non-English  language. 

Finally,  English  proficiency  is  measured  by  performance  on  c 
standardized  vocabulary  test.  Note  that  using  vocabulary-test  p 
formance  as  an  indicator  of  English  proficiency  builds  in  a  corr 
with  the  standardized-test  composite  that  is  used  as  a  measure  c 
student's  scholastic  achievement.  Although  it  would  have  been 
preferable  to  have  independent  measures  of  a  student's  English 
proficiency  and  scholastic  ability,  I  chose  this  specification  1: 
the  alternative  self-reported  measure  of  English  proficiency  (be 
a  set  of  items  parallel  to  the  proficiency  in  other  language  ite 
showed  very  little  variance. 

The  fact  that  the  measure  of  English  proficiency  is  correlat 
the  composite  test  measuring  scholastic  achievement  is  not  of  it 
disturbing.  Indeed,  it  is  difficult  to  imagine  any  measure  of  I 
proficiency  that  is  uncorrelated  with  these  tests  of  scholastic 
achievement  since  the  tests  are  written  in  the  English  language 
purport  to  measure  knowledge  and  skills  that  are  largely  taught 
schools  through  the  English  language.  In  addition,  my  experienc 
past  research  (Nielsen  and  Fernandez,  1982;  Fernandez  and  Nielse 
1984)  and  in  the  preliminary  stages  of  these  analyses  has  shown 
the  pattern  of  results  is  the  same  if  one  uses  the  vocabulary  te 
measure  of  English  proficiency  and  the  mathematics  test  as  a  mec 
scholastic  achievement,  or  the  vocabulary  test  with  the  coraposit 
(i.e.,  reading,  vocabulary,  and  mathematics)  as  a  measure  of  scl 
achievement,  as  I  have  done  here. 


DESCRIPTIVE  ANALYSES 
Sophomores 

For  High  School  and  Beyond,  sophomores  were  interviewed  in  I 
two  years  later,  regardless  of  whether  they  were  still  in  high  s 
Table  1  presents  high  school  dropout  rates,  by  sex  and  populatic 
subgroup,  for  the  sophomores . H 


3Self-reported  measures  of  language  practices  have  been  found  tc 
highly  reliable  and  valid  (see  Fishman,  1969;  Fishman  and  Coope] 
1969;  Fishman  and  Terry,  1969).  Fishman  and  Terry  (1969)  attri 
these  qualities  to  the  fact  that  respondents  are  forced  to  perf< 
global  assessment  of  their  linguistic  behavior.  Many  objective 
measures  capture  more  fragmentary  aspects  of  language  usage  and 
correspondingly  lower  validity. 

"The  standard  errors  reported  in  the  descriptive  analyses  have  1 
corrected  for  the  effects  of  sample  design. 


TABLE  1  Dropout  Rates,  by  Sex  and  Population  Subgroup,  for  Sophomore 
Cohort 


Male 

Female 

Population 

Subgroup 

Percent 

Standard 

Error 

Sample 

Size 

Percent 

Standard 

Error 

Sample 

Size 

All  Hispanics 

18.5 

1.3 

2,280 

18.1 

1.3 

2,210 

Mexican  American 

21.4 

1.8 

1,288 

20.8 

1.8 

1,270 

Cuban 

14.6 

4.2 

184 

26.5 

5.2 

189 

Puerto  Rican 

24  .0 

4.3 

258 

21.5 

4.3 

240 

Other  Latin 
American 

12.0 

2.2 

550 

10.8 

2.2 

511 

Non-Hispanic  blacks 

20.3 

1.6 

1,685 

14.2 

1.3 

1,961 

Non-Hispanic  whites 

13.4 

0.6 

9,226 

11.6 

0.6 

9,340 

SOURCE:  Data  from  High  School  and  Beyond. 

The  high  school  dropout  rate  for  Hispanic  males  overall  (18.5 
percent)  is  lower  than  the  rate  for  blacks  (20.3  percent)  and  higher 
than  the  rate  for  whites  (13.4  percent).  Consistent  with  past  research 
on  high  school  noncompletion  (National  Center  for  Education  Statistics, 
1980: Table  2.31)  among  males,  Puerto  Ricans  have  the  highest  dropout 
rate  (24.0  percent),  followed  by  Mexican-Amer icans  (21.4  percent). 

"Other  Latin  Americans"  have  the  lowest  dropout  rate  among  males,  lower 
than  whites  (12.0  versus  13.4  percent),  and  the  rate  for  Cuban  males 
(14.6  percent)  is  slightly  higher  than  the  rate  for  whites. 

Among  females,  Hispanics  overall  have  the  highest  dropout  rate 
(18.1  percent,  compared  with  14.2  percent  for  blacks  and  11.6  percent 
for  whites) .  Cuban  females  have  the  highest  dropout  rate  of  any 
subgroup  of  either  sex,  26.5  percent.  The  pattern  for  the  remaining 
Hispanic  subgroups  is  the  same  as  that  for  males:  the  rate  for  Puerto 
Ricans  is  highest  (21.5  percent),  followed  by  Mexican-Amer icans  (20.8 
percent)  and  other  Latin  Americans  (10.8  percent). 

The  mechanisms  underlying  these  differences  in  dropout  rates  are 
unclear.  In  part  because  of  problems  of  data  availability,  very  little 
empirical  research  exists  on  the  causes  of  these  different  dropout 
rates.  However,  the  limited  research  available  suggests  that  Hispanics 
are  likely  to  drop  out  in  order  to  work  and  help  support  the  family 
(National  Council  of  La  Raza,  1980).  At  least  for  males,  the  dropout 
statistics  in  Table  1  are  consistent  with  this  hypothesis:  the  dropout 
rates  for  the  various  subgroups  increase  as  the  median  family  income  of 
the  subgroup  decreases  (National  Center  for  Education  Statistics,  1980). 
The  same  pattern  holds  for  females,  with  the  exception  of  blacks,  who 
drop  out  less  than  one  would  expect,  and  Cubans,  who  drop  out  more  than 
one  would  expect. 
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Table  2  also  lends  support  to  the  idea  that  Hispanic  males  t 
drop  out  for  financial  reasons.  Table  2  shows  labor  force  statu 
school  enrollment  status  for  the  sophomores .  Among  out-of-schoo 
males,  Hispanics  overall  show  a  higher  degree  of  labor  force  att 
than  do  whites  or  blacks?  85  percent  of  Hispanic  males  were  in 
labor  force  compared  with  82.5  and  73.1  percent,  respectively,  f 
whites  and  blacks.  The  relatively  poor  Mexican-Americans  show  t 
highest,  and  the  relatively  rich  Cubans  the  lowest,  degree  of  la 
force  involvement  among  the  out-of-school  males.  In  agreement  w 
past  research  (Ryscavage  and  Mellor,  1973;  Newman,  1978),  the  po 
subgroup  of  all,  the  Puerto  Ricans,  show  a  very  low  rate  of  labo 
participation.  However,  this  is  probably  due  to  their  very  high 
of  military  enlistment  (see  Table  2) .  A  number  of  researchers  h 
noted  that  because  Puerto  Ricans  are  heavily  concentrated  in  New 
City,  which  has  had  a  declining  economy  in  recent  years,  job  opp 
tunities  for  Puerto  Ricans  have  worsened  (Newman,  1978;  National 
Council  of  La  Raza,  1980) .  Enlistment  in  the  military  is  common 
those  faced  with  bleak  job  prospects. 

Considering  females'  labor  force  participation  rates  among  t 
who  are  out  of  school,  Hispanics  overall  again  have  a  lower  rate 
participation  than  either  whites  or  blacks.  However,  unlike  pas 
research  on  the  adult  population  that  has  shown  that  the  labor  f 
participation  rate  of  Puerto  Rican  females  is  especially  low  (Ry 
and  Mellor,  1973;  Newman,  1978)  and  declining  (Santana-Cooney,  1 
Santana-Cooney  and  Warren,  1979;  National  Commission  for  Employm 
policy,  1982),  Table  2  shows  that  among  youths,  Puerto  Rican  fern 
have  the  highest  rate  of  labor  force  participation,  even  higher 
white  females  (67.8  versus  66.0  percent).  Also  contrary  to  the 
research  on  the  adult  population  that  shows  that  Cuban  females  h 
high  rate  of  labor  force  participation  relative  to  other  Hispani 
subgroups  (see  Ryscavage  and  Mellor,  1973;  Newman,  1978:Table  1; 
National  Commission  for  Employment  Policy,  1982) ,  the  data  in  Ta 
show  Cubans  have  the  lowest  labor  force  participation  rate  among 
youths . 5 

While  out-of-school  Hispanics  are  more  likely  than  out-of-sc 
whites  to  participate  in  the  labor  force,  Hispanics  are  less  sue 
that  whites  in  finding  employment.  For  both  sexes,  unemployment 
among  out-of -school  Hispanics  are  considerably  higher  than  those 
out-of-school  whites  (males:  30  versus  21.8  percent;  females: 
versus  26.6  percent) ,  albeit  not  as  high  as  among  out-of -school 
(36.8  percent  for  black  males  and  47.4  percent  for  black  females 
This  is  consistent  with  past  research  on  the  general  population 
McKay,  1974;  Newman,  1978).  Also,  consistent  with  past  research 
adult  population  (Newman,  1978;  National  Commission  for  Employme 


5 Aside  from  differences  in  the  age  groups  studied,  the  discrepar 
between  the  results  in  past  research  and  the  analyses  here  are  p 
due  to  differences  in  the  target  population.  Note  that  none  of 
sources  reports  data  on  out-of-school  youths. 


?olicy,  1982) ,  Puerto  Rican  males  have  the  highest  unemployment  rate 
among  Hispanic  subgroups.  However,  the  employment  situation  of  other 
jatin  Americans  who  are  out  of  school  is  significantly  better:  their 
unemployment  rates  for  both  sexes  are  relatively  low,  for  males  even 
.ower  than  the  unemployment  rate  for  whites.  Somewhat  of  a  surprise, 
>ut-of~school  Cuban  females  show  the  highest  jobless  rate  in  Table  2, 
>2.5  percent.  The  employment  situation  of  out-of-school  Puerto  Rican 
females  is  also  relatively  poor,  albeit  not  as  bad  as  for  Cuban  and 
)lack  females  who  are  out  of  school.  Finally,  out-of-school  Mexican- 
American  males  and  females  show  very  similar  unemployment  rates  (32.6 
versus  32.3) . 

Turning  now  to  students,  labor  force  participation  rates  among 
lales  enrolled  in  school  do  not  vary  much  among  ethnic  subgroups  (75.5 
;o  79.5  percent).  For  female  students,  the  variation  in  labor  force 
sarticipation  rates  across  ethnic  subgroups  is  considerably  more  than 
Eor  males  (67.3  to  77.7  percent)  but  is  much  less  than  the  ranges  for 
ligh  school  dropouts  of  either  sex  (males:  70.2  to  90.1  percent; 
females:  47.4  to  67.8  percent). 

But  while  rates  of  labor  force  participation  do  not  vary  much, 
chances  of  employment  do.  Among  male  students,  Puerto  Ricans  have  the 
lighest  unemployment  rate  of  any  subgroup  (27.5  percent).  Only  black 
female  students  have  a  higher  unemployment  rate,  32.6  percent.  Among 
nale  Hispanics,  Mexican-Americans  have  the  lowest  unemployment  rate 
(14.8  percent) ,  and  among  female  Hispanics,  other  Latin  Americans  have 
the  lowest  unemployment  rate  (16.3  percent). 

Comparing  students  to  dropouts,  no  simple  pattern  emerges  for  labor 
force  participation  rates  among  males.  In  some  cases,  e.g.,  Mexican- 
Americans,  dropouts  have  a  higher  degree  of  labor  force  attachment  than 
students  (90.1  versus  77.2  percent),  but  in  other  cases,  such  as  Cuban 
nales ,  students  have  a  higher  level  of  labor  force  involvement  than 
iropouts  (75.5  versus  70.2  percent).  However,  the  unemployment  statis¬ 
ts  for  males  show  a  clear-cut  pattern:  once  in  the  labor  force,  high 
school  dropouts  have  a  more  difficult  time  finding  work  than  youths  who 
remain  in  school.  This  pattern  could  reflect  employers'  responses  to 
iropouts'  relative  lack  of  education.  An  alternative  explanation  for 
this  pattern  is  that  high  school  students  and  dropouts  seek  different 
<inds  of  jobs.  For  example,  high  school  students  largely  seek  part- 
time  employment  (Lewin-Epstein,  1981) ,  while  dropouts  are  more  likely 
to  look  for  full-time  work  (Borus,  1983).  Differences  in  unemployment 
rates  may  simply  reflect  differences  in  the  job  markets  in  which 
students  and  dropouts  search  for  work.  Youths  who  are  looking  for 
(full-time  work  may  be  more  disadvantaged  than  youths  searching  for 
part-time  jobs  because  those  who  seek  full-time  employment  are  likely 
to  be  competing  with  adult  workers  who  have  considerable  labor  force 
experience.  In  contrast,  the  job  market  for  part-time  work  is  likely 
to  be  less  competitive. 

Considering  the  statistics  for  females,  the  pattern  is  clear  across 
all  subgroups:  dropouts  are  less  involved  in  the  work  force  than 
students.  Part  of  this  pattern  may  be  due  to  a  discouraged  worker 
affect.  Because  female  dropouts  have  relatively  poor  employment 
prospects,  as  evidenced  by  their  very  high  unemployment  rates,  females 
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Enrolled  in  School 
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a  eocond  explanation  for 

choose  to  stay  out  of  the  Xa^tce.  -  schooX  in  the  «.£l 

^aH-prn  is  related  to  j.  _  t-hev  were  pregnant  ^ 

lince  many  females  dropped  out to  expect  that  many  . 
married  (see  '.  therefore ,  they  are  not  counted 

Chose  the  role  of  b»*-ker  ^  participation. 


Seniors 


High  school  and  Beyond  als^  -Uo^uP,  “ 

respondents  who  were  se”?'°^i  by  sex  and  population  sub^r.°“P‘ 
nostsecondary  school  activit  Y  postsecondary  education  r 

P  nlspanicl  are  underrepresented Centet  for  Education 

to  their  share  of  the  P°P“  However,  Hispanics  who  have  gra 

Statistics,  1980:lable  3.01.  'on  to  college  at  a  rate  ■ 

from  high  school  have  been  found  *  lg8tein  and  Fernandez,  1 
(Peng,  1977;  Duran,  1983’  9  Peng  (1977)  speculates  that  th 

1984)  than  non-Hispanic  ;f  affirmative  action  pt°9ta  ^ 

pattern  is  due  to  the  succes  ,  ing  interpretation  that  this 
(1980)  ,  however,  offers  significant  barriers  to  Hispar 

is  actually  a  consequence  of  t  9  high  school  is  a  difficult 

ss-rsv^’^c 

highly6 mot'ivated'7 group  thmwhites'who  do  not  encounter  the  sa. 

obstacles  in  high  school.  interpretations  is  correct,  p. 

Regardless  of  which  ofth  favorably  with  other  groi 

research  shows  that  Hispanics  *  education  once  they  mak 

their  ability  to  gam  access  t^higher^^ ^  ^ 

through  high  school.  °^va  is  due  to  the  tendency  for 

equivalence  of  colleg  9  iunior  and  two-year  community  col 

disproportionately  to  at ten  3  1983)  argue  that  this  i 

Olivas  (1981)  and  ^^J^es'are  relatively  poorer  than  thei 
Hispanic  high  school  g  thus,  are  less  able  to  afford 

non-Hispanic  counterparts  and,  thus, 

colleges.  .  3  do  not  support  these  past  re: 

The  data  reported in  Tabl  x  graduates  are  less 

Both  male  and  female  Hispanic  nig  spanic_white  differenc 

go  on  to  college  than  whites.  1 H  ?  to  Hispanio 

rates  of  postsecondary 

underrepresentation  in  si2es,  the  standard  errors  fo 

Because  of  the  small  P  which  makes  inferences  for 

Hispanic  subgroups  are  ve  y  1  9  the  following  pattern 

Hispanic  subgroups  dlf  ”tage  not  attending  postseconc 

among  the  subgroups.  Th  P  q  RJan  males  (57.8  percent),  l 
is  particularly  hl9 icans  and  other  Latin  Americans.  Only 
*Ss  have Thigher  rate  of  postsecondary  attendance  than  wh. 
versus  62.2  percent) . 
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„annot  resolve  the  issue  here,  it  is  »»  8P^£l 
Although  I  cannot  f  from  those  of  past  research  because 

the  results  reported  differ  ^  data  reported  in  most^ 

differences  in  sample  design.  longitudinal  study  of  a  gr<= 

Studies,  High  school  and  Beyond  -  a  ^  1980.e  other  studies 
based  cohort  of  stuaeaka '  1 1 ^  graduates  in  household  surveys 
renort  percentages  of  high  _  l983:Table  1)  who  go 

the  Current  population  Surveys ,  a®tion  is' used  to  define  the  sui 
college.  Sometimes  an  age  *  a  broad  range;  for  example,  Durs 
population,  but  it  is  typically  If  by  being  poorer  tha 

(1983)  uses  the  P°P“L^.1°nag^ve  discontinuities  in  their  educ. 
Hispanics  are  more  llkaPyt!°e  ponger  to  make  the  transition  to 
careers  and  therefore  to  take  long  studies  of  grade  cohorts 

college,7  college-going  rates  Hispanics  lagging  m  th 

as  in  High  School  and  Beyond '  Lse  that  Hispanics  go  on 

rates  of  college-going.  higher  than  whites  but  that  it  ta 

college  at  rates  eqaf  °tuaies  of  broad  age  cohorts,  such  as 
longer  for  them  to  do  so,  stu  n  Qf  whether  Hispanics  ; 

(1983) ,  that  do  not  examin  show  that  Hispanics  have  reac 

overage  compared  with  whi  aiscrepancy  between  these  results  1 
parity  with  whites.  those  based  on  other  studies  is  due 

High  School  and  Bey°ad  an^0  get  to  college,  then  the  discrepan 
Hispanics’  taking  1°nq®  ad  Beyond  cohort  ages . 

diminish  as  the  High  labor  force  status  by  postsecondary 

Table  4  shows  seniors  lab  Here,  too,  the  smal 

attendance,  sex,  and  popu  *  \  the  HiSpanic  subgroups  diffic 
sizes  make  inferences  conc®r^  interpreting  differences  among 
caution  should  be  for  the  sophomore, 

Hispanic  subgroups.  military  enlistment  two  years 

Rican  males  have  a  ig  percent).  Black  males  also  have 

high  school  graduation  (  •  nt) .  Although  much  lower 

military  the  corre 

absolute  size  than  ,  aiso  high  relative  to  white 

rate  for  Puerto  Rican  f®malaa  uitary  enlistment  rate  among 
,5.2  versus  2. 3  Percent)^  The^mili  ^  ^  p 

females  is  similar  force  participation  of  males  who  ar 

considering  the  labor  fo  £  tion  in  the  labor  force 

enrolled  in  school,  rates  P  much  across  et 

high  (greater  than  90  percent)  and  do  not  v  y  ^  ^  labor  f 
subgroup,  ^fl,  Hispanic  males  pa^^P  ^  ^  g2 

-srr;  sirs**-  out-of-schooi 


.  .  .  i,orp  His  results  are  based  on 

6 Pena  (1977)  is  an  exception  her  . 

Class  of  1972  National  Longitudma 


.  ,  i-hat-  family  socioeconomic  status  is  inversely 

?For  evidence  that  fam  y  ^  ^  general  population,  see  Fee 

to  schoo  ^con  eviaence  on  socioeconomic  status  and  thr 
educational^  tr ans^tions ,  see  Hogan  (1981). 


percent.  ,h  rates  for  males,  the  labor  fore  p 

Although  not  as  high  as  the  ara  fairly  high.  However, 

ticipation  rates  of  ou  -°  .  . erat>le  variation  across  ethnic 

unlike  the  males,  there  is  °  Female  Hispanics  participate  in  the 

subgroup  in  the  rates  fo  "  .  eaual  to  that  of  white  females 

labor  force  at  a  rate  that  «  wgher  than  the  rate  for 

(83.3  versus  84.4  percent) ,  1 but  *  females  are  substantially  more 
black  females  (78.2  percent). -Cuban  «  than  white  females:  almost  95 
likely  to  participate  in  the  labo  females  were  employed  or 

percent  of  out-of-school  oivili  Cb  ^  £or  white  females.  Puerto 
looking  for  work,  compared  wi  b  e4st.Plabor  force  participation  rate 
Rican  females,  who  showed  the  hl9b®a  ralatiVeiy  low  rate  of 
among  out-of-school  when  followed  up  two  years  later, 

participation,  i.e.,  79.  P  for  0ut-of-school  males. 

Turning  to  the  unemployment  rat  rate  that  is  slightly  higher 

Hispanics  overall  h^e  ™ ompared  with  14.8  percent),  but  substantia  y 
than  that  of  whites  18  c. ampai c  fc  male  Hispanic 

lower  than  that  of  black  (  •  hiahest  and  Cubans  the  lowest 

subgroups,  Puerto  Ricans  £  percent,  respectively), 

unemployment  rates  (19.5  and  14  J?  employment  prospects  are 

Among  out-of-school  females,  P/as  those  of  blacks, 

much  poorer  than  th°s%°bla^  f^es  are  unemployed,  compared  with 
More  than  40  percent  of  black  Hispanic  females,  respectively. 

17.8  and  27.7  percent  of  white  ^  the  highest  rate  of 

Among  Hispanic  subgroups ^  ubanj Ehl^est  unemployment  rate  in  Table  4^ 

Because^of "their  *  small  sample  site,  statistics  for  the  Cubans  s 

interpreted  with  caution.  _nrolled  in  postsecondary  education,  labor 

Looking  at  those  who  are  ^ong  males,  only  44.5  percent 

force  participation  rates  are  v  y  percent  of  Hispanics  are 

of  whites,  38.8  percent  °f  “f^endLg ^secondary  education.  For 
employed  or  seeking  work  while  attendi  rates  of  labor  force 

both  sexes,  Mexican-Amer ican  females:  58.6  percent).  Puerto 

participation  (males:  59 * labor  force  participation  rates 

Ricans  of  'both  sexes  show  the  1°^  £br  °aIes  and  54.2  percent  for 

among  Hispanic  subgroups:  39.9  percen  a,ration 

femaiene;Ployment  rates  for  unemploy- 

follow  the  same  pattern  found  for  the^oth^  P^  ^ tes  and  iower  than 
ment  rate  for  Hispanics  is  higher  th  for  other  populations, 

that  for  blacks.  Consistent  “e  nt  rate  among  male  Hispanics 

Puerto  Ricans  show  the  hig  e  .  ^Mexican-Americans  show  the 

(27.6  percent) .  Among  female  Hispanic  , 

highest  rate  of  unemployment  <: 15..  )  ] P£oro6  status  of  seniors  (Table  4) 
Finally,  comparison  of  the  1  s  g  number  of  interesting 

with  that  of  sophomores  <Tab]-®  1  f  high  school  dropouts  with  seniors 

patterns.  For  one,  a  compari -hOMS  that  the  seniors  have  uniformly 
who  have  not  gone  on  to  °°bat ion  rates  and  uniformly  lower  unemployment 
higher  labor  force  participation  rare 
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vouths  in  the  senior  cohort 

rates.  This  is  not  surpr ^n^0phomore  cohort  (on  average,  19  versus 
are  older  than  youths  m  the  P  h  than  high  school  dropouts. 

17)  and  are  high  school  graduates  ftom  both  cohorts,  the 

But  if  we  consider  youths  w  .  reverses.  Students  in  high 

pattern  for  labor  force  participa  of  labor  force  participation 

school  (sophomores)  have  T* v  schools.  However,  among  those  in  school 
than  students  in  P°st®®co^®  J  force,  the  chances  of  employment  are  no 
-  -^‘SfSrS:  f or°member  s  of  the  sophomore  and  senior 

C°h°These  patterns  imply  tha^  hi^t“a°°s  enroUed  tn^stsecondary 
attached  to  the  labor  force  than  en^  ^  these  tternS!  (1) 

schools.  There  are  two  possible  P  ities  £or  labor  force 

postsecondary  study  allows  £®”®r  .  operating  so  that  students  who 

involvement,  and  (2)  salf-^®C^°ntbe  ones  who  wish  to  concentrate  on 
attend  postsecondary  education  aue  to  the  need  of  Hispanics  to 

their  schooling.  These  results  may  hites  because  Hispanics  are 

participate  in  the  labor  ^  of  postsecondary  educatic 

poorer  and  are  less  a  selection,  Hispanic  high  school  s  u 

participate3 irT theS laborB force  at  higher  rates  than  postsecondary 

StU^Compar isons  of  youth  who the  causal 
suggest  that  caution  should  be  (presented  in  the  next  sectioi 

analyses  of  seniors'  labor  force  status  (P^  ^  ^  inolud  .high 

Unlike  the  sophomore  coh“  '  x  analyses  that  follow  are  subject  t 

school  dropouts.  Thus,  the  ^ausa^^a^oblem  is  compounded  by  the  fa 
selection  bias  (Heckman ,197  )•  P  markedly  different  selecti 

that  the  various  population  subgroup  _  T[)e  data  for  the  sophomore 
rates  due  to  dropping  ou  (  blem>  because  pre-sophomore  year 

cohort  are  not  subgec  Hispanics  and 

attrition  rates  are  small  an i  ™  ™  / 

_ ni snanics  (Rumberger -  1983. Table  i) 


multivariate  analyses 


Analysis  Strategy 


in  this  section,  I  develop  models 
for  whites  and  Hispanics. 


of  labor  force  participation  c 
The  purpose  is  to  test  a 


-ei^-TSt  I  dc 

section*  are  estimated  by  ,ha 


number  of  hypotheses  derived  from  the  literature  concerning  the  causes 
of  Hispanics"  underachievement  in  the  labor  market.  Specifically/  the 
purpose  is  to  test  whether  Hispanic-white  differences  in  general 
background  factors,  such  as  family  income  or  scholastic  achievement, 
account  for  Hispanics"  difficulties,  or  whether  specific  factors  that 
differentiate  Hispanics  from  the  white  majority,  such  as  language  or 
recency  of  migration,  explain  these  difficulties. 

My  strategy  is  to  first  specify  separate  models  of  labor  force 
participation9  for  white  and  Hispanic  sophomores  and  seniors. 

Because  of  the  small  numbers  of  Cubans  and  Puerto  Ricans  in  the  sample, 
the  various  Hispanic  subgroups  have  been  aggregated  and  dummy  variables 
have  been  included  to  distinguish  subgroup  membership.  Although  it 
would  have  been  preferable  to  explore  subgroup  interactions  with 
respect  to  the  models  developed  here,  my  preliminary  analysis  has  shown 
that  the  numbers  of  Cubans  and  Puerto  Ricans  are  very  small  and 
therefore  likely  to  yield  unreliable  estimates. 

Because  there  is  evidence  that  decisions  about  school  continuation 
and  labor  force  participation  are  interrelated  (Duncan,  1965;  Edwards, 
1976;  Ornstein,  1976),  I  treat  labor  force  participation  and  school 
enrollment  status  as  joint  dependent  variables.10  Therefore,  the 
dependent  variable  has  four  categories:  in  the  labor  force  and  in 
school,  in  the  labor  force  and  out  of  school,  out  of  the  labor  force 
and  in  school,  and  out  of  the  labor  force  and  out  of  school.  Three 
dummy  varibles  are  created  for  membership  in  these  four  categories. 

They  are  labeled  LFPl,  LFP2 ,  and  LFP3  and  correspond  to  the  first  three 
categories  above.  The  excluded  (base)  category  is  out  of  the  labor 
force  and  out  of  school.  Each  of  these  three  dummy  variables  is 


linguistic  patterns  on  labor  force  and  school  enrollment  status. 
Although  there  is  evidence  that  linguistic  factors  are  important  in 
determining  black  students'  school  achievement  (see  Dillard,  1973:Ch. 

7;  Harber  and  Bryen,  1976;  Labov,  1976),  the  literature  focuses  on  the 
use  of  nonstandard  English  dialects,  i.e.,  "Black  English."  Since  the 
language  data  in  High  School  and  Beyond  does  not  contain  any 
information  about  dialects,  but  is  geared  toward  the  identification  of 
foreign-language  users,  the  language  issue  for  blacks  cannot  be 
properly  addressed. 

9 As  with  the  descriptive  analyses,  those  who  are  enlisted  in  the 
military  are  defined  as  being  out  of  the  labor  force.  Therefore,  the 
equations  presented  predict  participation  in  the  civilian  labor  force. 

10An  alternative  here  would  be  to  use  school  enrollment  status  as  a 
predictor  of  labor  force  status.  However,  if  it  is  true  that  decisions 
about  school  continuation  and  labor  force  participation  are  made 
jointly,  the  results  of  such  a  specification  would  suffer  from 
simultaneity  bias  (Theil,  1971:429-432). 
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predicted  by  means  of  logistic  regression  analysis.11  The 
coefficients  estimated  from  these  models  represent  the  effects  < 
independent  variables  on  the  probability  (log-odds)  of  being  in 
particular  labor  force-school  enrollment  status  (i.e.,  LFPl,  lf: 
LFP3)  as  opposed  to  being  in  the  base  category  (i.e.,  out  of  th< 
force  and  out  of  school) . 

The  next  step  is  to  specify  models  for  employment  versus  un 
ment  for  whites  and  Hispanics  in  both  cohorts.  Parallel  to  lab< 
participation,  employment  and  school  enrollment  are  treated  as 
determined  variables.  The  dependent  variable  has  four  categori< 
employed  and  in  school  (labeled  EMP1)  ,  employed  and  out  of  scho< 
(EMP2)  ,  unemployed  and  in  school  (EMP3)  ,  and  unemployed  and  out 
school  (the  base  category) .  A  set  of  logistic  regressions  is  t 
to  predict  membership  in  the  first  three  employment-school  enro. 
statuses  (i.e.,  EMPl,  EMP2,  and  EMP3)  .  Because  employment  is  d 
only  for  those  who  participate  in  the  labor  force,  the  estimate 
derived  from  the  logistic  regressions  for  employment  are  condit 
participation  in  the  labor  force. 


Results 

Tables  5  and  6  show  the  number  of  cases  used  in  the  analysi 
the  means  and  standard  deviations  of  the  independent  variables 
labor  force  participation  and  employment  models  for  white  and  H 
sophomores  and  seniors. 

The  data  in  Table  5  confirm  a  number  of  findings  of  past  re 
(see  above)  .  Hispanic  youths  tend  to  come  from  poorer  families 
white  youths.  Hispanics  show  a  shorter  length  of  U.S.  residenc 
three  length-of-residence  variables.  Hispanics  are  also  much  m 
likely  to  be  bilingual  and,  among  bilinguals,  to  report  a  great 
facility  with  the  non-English  language  (i.e.,  Spanish)  than  whi 
Hispanics  also  do  poorly  in  school  relative  to  whites:  they  ha 
grades  and  score  less  well  on  standardized  tests.  These  patter 
the  same  for  both  the  sophomore  and  senior  cohorts.  These  resu 
also  similar  for  those  respondents  who  are  in  the  labor  force  ( 
6)  . 


Labor  Force  Participation  of  Sophomores 

Table  7  presents  the  results  of  the  logistic  regression  ana 
for  white  and  Hispanic  sophomores'  labor  force  participation-sc 
enrollment.  For  both  Hispanics  and  whites,  only  one  sex  effect 
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Sophomores 


Seniors 


White 


Mean 


LFP1 

LFP2 

LFP3 

Sex  (1 =male) 

Age 

Mexican  American 
Cuban 

Puerto  Rican 
Other  Latin 
American 
Bilingual 
(1 =yes) 

Proficiency  in 

non-English 

Language 
Vocabulary 
Test  Score 
Composite 
Test  Score 
Grade  Point 
Average 

Marital  Status 
Worked  During 
Base  Year 
Length  of 
Residence 
Father’s  Length 
of  Residence 
Mother’s  Length 
of  Residence 
Socioeconomic 
Status 


.73 

.04 

.21 

.47 

15.47 


.04 

.06 

50.62 

53.02 

2.84 

.03 


.44 

.20 

.41 

.50 

.59 


.20 

.35 

9.36 

8.42 

.78 

.17 


Hispanic 


White 


Hispanic 


.65 

.07 

.26 

.48 

15.62 

.53 

.10 

.10 

.27 

.51 

1 .04 

45.52 

46.49 

2.63 

.04 


.48 

.26 

.44 

.50 

.74 

.50 

.30 

.30 


S.D.  Mean  S.D.  Mean 


.25 

.36 

.30 

.46 

17.43 


S.D, 


.43 

.48 

.46 

.50 

.57 


Mean 


.28 

.42 

.21 

.44 

17-57 

.12 

.08 


S.D. 


.45 

.49 

.41 

.50 

.69 

.33 

.27 


.44 

- 

- 

.23 

.42 

.50 

- 

- 

.63 

.48 

1.12 

.07 

.36 

1.34 

1.15 

9-15 

55.18 

9.47 

49.23 

9.76 

7.94 

52.90 

8.23 

46.60 

7-94 

ro  -3 

O  ON 

3.02 

.11 

.70 

.31 

2.80 

.13 

.69 

.34 

.47 

.64 

.48 

.58 

.49 

2.43 

17-27 

1 .26 

16.41 

3-13 

11.77 

43.86 

4.92 

35.95 

12.93 

10.94 

40.85 

4.93 

33-50 

12.10 

.72 

.04 

.71 

-.50 

.74 

males  are  significantly  more  likely  than  females 
surfaces  in  Table  7.  pnrolled  in  school. 

to  be  in  the  labor  force  and  enrolle  ±  the  results  for  age 

Considering  the  other  involved  in  the  labor  force  and 

are  as  expected:  older  Hispanics,  older  youths  are  more  ^  f 

less  involved  in  school.  VPschooi  (see  equation  for  LFP2)  and 

to  be  in  the  labor  force  a^out  of  schoo^  force  (equatlon 

are  less  likely  to  be  in  a  out  of  school. 

LFP3)  than  out  of  the  labor  similar  pattern,  although  one 

The  results  for  whites  foil  the  effect  of  age  in  the 

effect  is  statistically  significant,  i.e.. 


TABLE  6  Means  and  Standard  Deviations  for  Variables  in  Employn 
Status-School  Enrollment  Analysis 


Sophomores 

Seniors 

White 

Hispanic 

White 

Hi: 

Mean 

S.D. 

Mean 

S.D. 

Mean 

S.D. 

Mean 

EMP1 

.80 

.40 

.72 

.45 

.36 

.48 

.35 

EMP2 

.04 

.20 

.07 

.26 

.49 

.50 

.48 

EMP3 

.14 

.35 

.19 

.39 

.05 

.22 

.05 

Sex  (1=male) 

.48 

.50 

.50 

.50 

.45 

.50 

.43 

Age 

15.48 

.59 

15.65 

.75 

17.42 

.56 

17.57 

Mexican  American 

- 

- 

.52 

.50 

- 

- 

.60 

Cuban 

- 

- 

.09 

.29 

- 

- 

.12 

Puerto  Rican 
Other  Latin 

- 

- 

.10 

.30 

.07 

American 

- 

- 

.29 

.45 

- 

- 

.22 

Bilingual 
( 1=yes) 

Proficiency  in 

.04 

.20 

.50 

.50 

.04 

.20 

.62 

non-English 

Language 

.06 

.33 

1 .02 

1.12 

.07 

.35 

1.31 

Vocabulary 

Test  Score 
Composite 

50.55 

9.23 

45.25 

8.98 

53.89 

9.44 

48.22 

7.84 

8.13 

45.85 

Test  Score 
Grade  Point 

52.90 

8.20 

46.31 

51.50 

Average 

2.82 

.77 

2.61 

.75 

2.92 

.70 

2.75 

Marital  Status 
Worked  During 

.02 

.14 

.03 

.17 

.13 

.34 

.12 

Base  Year 

.50 

.50 

.40 

.49 

.70 

.46 

.62 

Length  of 
Residence 
Father's  Length 

15.34 

1.13 

14.88 

2.42 

17.29 

1.12 

16.44 

36.14 

of  Residence 

41 .75 

5.02 

36.06 

11.64 

43.86 

4.91 

Mother's  Length 
of  Residence 
Socioeconomic 

38.93 

4.56 

33.37 

10.90 

40.84 

5.00 

33.65 

Status 

.12 

.67 

-.35 

.71 

-.07 

.66 

-.55 

(N. 

=2,613) 

(N= 

1 ,580) 

(N=2 

,664  ) 

l 

equation  for 

LFP1 : 

younger 

white  youths 

are  more 

likely 

to  be 

labor  force  and  in 

school  than  in 

any  of 

the  other 

categories. 

The  independent  effects  of  marital  status  on  labor  force  p< 
tion  and  school  enrollment  are  similar  for  whites  and  Hispanic; 
for  this  very  young  group.  For  both  whites  and  Hispanics,  hav: 
married  decreases  the  chances  of  being  in  the  labor  force  and  . 
and  increases  the  odds  of  being  in  the  labor  force  and  out  of  i 
opposed  to  being  in  either  of  the  out-of-the-labor-force  categ< 
(i.e.,  the  base  category  and  LFP3) .  For  both  whites  and  Hispai 
married  people  find  it  particularly  difficult  to  participate  ii 
school  and  the  labor  force. 


TABLE  7  Effects  of  Independent  Variables  on  Labor  Force  Participation-School  Enrollment  Status  for 
White  and  Hispanic  Sophomores 
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The  scholastic  achievement  variables  show  significant  effects  fo] 
both  whites  and  Hispanics.  For  Hispanics,  the  higher  the  base-year 
grade-point  average,  the  greater  the  probability  of  being  in  school  a 
out  of  the  labor  force  and  the  lower  the  chances  of  being  in  the  labc 
force  and  out  of  school  (see  equations  for  LFP2  and  LFP3) .  This  same 
pattern  surfaces  for  whites  as  well,  but  the  t-test  for  the  coefficie 
in  the  equation  for  LFPl  fails  significance.  Performance  on  the  batt 
of  standardized  tests  is  not  related  to  labor  force  participation  or 
school  enrollment  once  the  other  predictors  in  the  model  are  controll 
The  equation  for  Hispanics  predicting  LFP2  is  an  exception:  better 
performance  on  the  test  battery  lowers  the  chances  of  being  out  of 
school  and  in  the  labor  force. 

The  lack  of  significant  effects  for  the  composite  test  score 
suggests  that  between-school  variation  in  scholastic  achievement  is 
largely  irrelevant  to  dropout  and  labor  force  decisions.12  The 
significant  effects  of  grade-point  average,  which  only  vary  within 
schools,  strongly  suggest  that  the  effects  of  scholastic  achievement 
dropout  and  labor  force  participation  decisions  are  highly  contextual 
It  is  only  students'  scholastic  achievement  relative  to  others  in  the 
school  context  that  affects  their  decisions  to  leave  school  and/or 
participate  in  the  labor  force. 

The  last  of  the  general  variables,  i.e.,  previous  work  experience 
has  similar  effects  on  labor  force  participation  and  school  enrollmer 
for  Hispanics  and  whites.  Those  respondents  who  worked  at  the  time  c 
the  base-year  survey  are  less  likely  to  be  exclusively  in  school  (see 
the  equations  for  LFP2) ,  although  the  effect  for  Hispanics  fails  to  fc 
significant.  Previous  work  experience  also  increases  the  chances  ths 
both  whites  and  Hispanics  combine  school  and  labor  force  activities 
(LFPl)  and  decreases  their  chances  of  being  out  of  school  and  in  the 
labor  force  (LFP3) .  Therefore,  unlike  previous  studies  that  find  the 
high  school  students  who  work  suffer  significant  costs  in  terms  of 
their  schooling  (Steinberg  et  al.,  1982b),  these  data  show  no  tendenc 
for  either  Hispanics  or  whites  to  be  pulled  out  of  school  and  into  th 
labor  force  by  virtue  of  having  worked  during  their  sophomore  year. 

Considering  the  effects  of  specific  factors  on  youths'  labor  fore 
participation  and  school  enrollment,  none  of  the  length-of-U.S.- 
residence  variables  (i.e.,  mother's,  father's,  respondent's)  signifi¬ 
cantly  distinguishes  among  the  four  categories  of  the  dependent 
variable.  The  only  exception  is  the  coefficient  for  father's  length 
residence  in  the  equation  for  LFPl  for  Hispanics:  respondents  whose 
father  have  been  in  the  United  States  longer  are  more  likely  to  be  ir 
the  labor  force  and  in  school. 


1 2Recall  that  test  performance  varies  both  between  and  within 
schools,  while  grade-point  average  only  varies  within  school.  Becaus 
grade-point  average  is  controlled  in  these  models,  test  score 
performance  largely  taps  the  effects  of  between-school  variation  in 
scholastic  achievement. 


In  terms  of  the  effects  of  the  language  variables,  exposure  of 
Hispanics  to  Spanish  during  their  upbringing  does  not  significantly 
predict  school  continuation  or  labor  force  participation.  Although 
compared  with  Hispanics  relatively  few  whites  had  been  exposed  to 
another  language  (see  Table  7) ,  exposure  of  whites  to  a  non-English 
language  raises  the  probability  of  their  being  in  the  labor  force  and 
out  of  school. 

Contrary  to  expectations,  none  of  the  language  variables  signifi¬ 
cantly  distinguishes  among  the  four  categories  of  the  dependent 
variable  for  Hispanics.  Why  the  effect  of  non-English-language 
background  appears  for  whites  but  not  for  Hispanics  is  unclear. 

Last  among  the  language  variables,  the  effects  of  the  measure  of 
English-language  proficiency  (vocabulary  test  score)  on  labor  force 
participation  and  school  continuation  are  nil  for  both  Hispanics  and 
whites.  This  is  most  likely  because  the  main  effects  of  English- 
language  proficiency  for  these  youth  are  probably  through  scholastic 
achievement  (see  Nielsen  and  Fernandez,  1982),  which  has  been 
controlled  in  these  models. 

Finally,  the  dummy  variables  for  Hispanic  subgroup  show  only  one 
effect.  After  the  other  variables  in  the  model  are  controlled,  Cubans 
are  more  likely  to  combine  school  and  labor  force  activities  and  are 
less  likely  to  be  in  the  labor  force  and  out  of  school  than  any  of  the 
other  Hispanic  subgroups. 

The  lack  of  significant  effects  for  the  dummy  variables  for 
Hispanic  subgroup  implies  that  the  other  variables  in  the  model  have 
explained  the  subgroup  variation  in  school  continuation  and  labor  force 
participation.  Most  important  among  the  variables  that  have  been  found 
to  account  for  differences  in  achievement  among  Hispanic  subgroups  is 
family  socioeconomic  background.  For  example,  the  relative  affluence 
of  the  Cubans  (see  Jorge  and  Moncanz,  1980)  is  often  cited  as  a  major 
reason  for  Cubans'  greater  success  in  school  and  the  labor  market  (see 
Nielsen  and  Fernandez,  1982). 13  However,  other  variables  also 
explain  the  dependent  variables,  and  consequently,  differences  among 
Hispanic  subgroups  in  labor  force  participation  and  school  enrollment 
are  the  same  ones  that  are  important  for  whites,  i.e.,  scholastic 
achievement,  previous  work  experience,  and  marital  status.  According 
to  these  results,  the  processes  by  which  Hispanics  and  whites  decide  to 
stay  in  or  leave  school  and  participate  or  not  participate  in  the  labor 
force  are  very  similar.  The  "specific"  variables  that  I  hypothesized 
would  be  necessary  to  explain  Hispanics'  underachievement  have  proven 
to  be  insignificant. 


1 3Note  that  the  latest  wave  of  Cuban  immigrants,  the  Mariel  refugees, 
are  not  as  affluent  as  early  waves  (see  Bach,  1980).  However,  these 
data  do  not  contain  any  of  these  refugees  because  the  High  School  and 
Beyond  sample  was  drawn  prior  to  the  Mariel  boat  lift. 
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Employment  of  Sophomores 

Table  8  shows  the  coefficients  of  models  predicting  employment  an 
school  enrollment  as  joint  dependent  variables  for  sophomores.  SimiL 
to  the  results  for  labor  force  participation,  sex  does  not  significan 
distinguish  among  the  categories  of  the  dependent  variable.  Consider 
the  other  demographic  variables,  age  is  a  significant  predictor  in  tw 
equations,  i.e.,  EMPl  and  EMP2  for  Hispanics.  Older  Hispanics  are  le, 
likely  to  be  employed  and  in  school  and  more  likely  to  be  employed  an 
out  of  school  than  younger  Hispanics. 

Similar  to  the  pattern  for  labor  force  participation,  marital  sta 
is  a  strong  predictor  of  employment  and  school  continuation  for  both 
whites  and  Hispanics,  independent  of  the  other  variables  in  the  model 
Being  married  increases  the  chances  that  the  respondent  is  employed  a) 
out  of  school  and  lowers  the  probability  of  being  employed  and  in 
school  for  both  whites  and  Hispanics.  These  results  imply  that  both 
whites  and  Hispanics  are  more  likely  to  be  unemployed  and  out  of  scho 
or  unemployed  and  in  school  than  being  in  school  and  employed. 
Apparently,  employment  and  schooling  are  an  either-or  proposition  for 
those  whites  and  Hispanics  who  are  married. 

Looking  at  family  socioeconomic  background,  socioeconomic  status 
not  a  significant  predictor  for  either  whites  or  Hispanics.  The  fact 
that  the  effects  of  family  socioeconomic  background  are  weaker  for 
employment  than  for  labor  force  participation  for  whites  is  not  sur¬ 
prising.  Family  socioeconomic  background  may  make  it  more-or-less 
desirable  to  seek  employment,  but  actually  securing  a  job  involves 
convincing  an  employer  that  one  is  worth  hiring.  Especially  in  the 
youth  labor  market,  family  background  is  unlikely  to  be  an  important 
market  signal  to  employers  (see  Spence,  1974). 14  Although  the 
low-wage,  low-skill,  high-turnover  structure  of  the  youth  job  market 
(see  Osterman,  1980;  Borus,  1983)  is  likely  to  make  employers'  hiring 
decisions  less  dependent  on  productivity-related  criteria,  employers 
are  probably  more  likely  to  pay  attention  to  the  effects  of  past  work 
experience  and  the  characteristics  measured  by  the  second  set  of 
general  predictors,  i.e.,  scholastic  achievement. 

Similar  to  the  pattern  of  results  for  labor  force  participation, 
past  work  experience  increases  the  chances  of  being  in  the  two  employe 
categories  (i.e.,  EMPl  and  EMP2)  and  lowers  the  probability  of  being 
unemployed  and  in  school  (EMP3) .  This  pattern  is  similar  for  both 


1 4 Osterman  (1980)  shows  data  to  support  the  argument  that  parents  are 
crucial  in  helping  many  youths  get  started  in  the  job  market  by 
providing  youths  with  networks  of  personal  contacts  that  help  them  fir 
jobs.  The  effects  of  such  job  contacts  on  youths'  probability  of 
employment  is  certain  to  be  positive,  but  this  process  is  probably  on] 
marginally  related  to  these  family  background  factors.  Such  network 
variables  may  account  for  the  significance  of  mother's  and  father's 
presence  in  the  home  in  increasing  youths'  labor  force  participation 
and  employment. 


TABLE  8  Effects  of  Independent  Variables  on  Employment  Status-School  Enrollment  Status  for  White 
Hispanic  Sophomores 
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whites  and  Hispanics,  although  the  coefficient  in  the  EMP2  equation 
not  significant  for  Hispanics.  Here,  too,  there  is  no  evidence  of  w 
experience  drawing  students  out  of  school. 

General  scholastic  achievement,  as  measured  by  performance  on  th 
test  battery,  is  unrelated  to  the  dependent  variables  for  whites.  F 
Hispanics,  better  performance  on  the  tests  raises  the  probability  of 
being  employed  and  in  school.  The  pattern  for  the  test-score  coeffl 
ent  in  the  other  two  equations  implies  that  better  students  are  more 
likely  to  be  in  school,  but  neither  of  these  effects  is  significant. 
However,  two  of  the  three  coefficients  for  grades  are  significant  fo 
both  whites  and  Hispanics.  Higher  grades  increase  the  probability  o 
being  employed  and  in  school  and  decrease  the  chances  of  being  emplo; 
and  out  of  school. 

The  fact  that  grade-point  average  is  a  significant  predictor  of 
employment  suggests  that  employment  choices  are  also  made  within  the 
context  of  school.  But  unlike  the  case  with  labor  force  participate 
wherein  students  choose  whether  to  look  for  work,  employment  choices 
also  reflect  employers'  choices  among  competitors  looking  for  work. 
Because  of  the  highly  local  nature  of  the  youth  job  market  (see  Borui 
1983) ,  especially  for  younger  youths  (see  Osterman,  1980)  ,  it  is 
possible  that  employers'  hiring  decisions  are  also  made  with  referent 
to  the  same  school  context  that  students  refer  to  when  making  their 
labor  force  participation  decisions.  Therefore,  while  better  school 
performance  increases  students'  school  attachment  and  lowers  their 
probability  of  labor  force  participation  (see  Table  7) ,  employers  tr; 
to  choose  the  best  students  from  among  those  who  do  choose  to  par¬ 
ticipate  in  the  labor  force — if  not  for  their  skills,  then  simply  fo: 
their  better  discipline  (for  a  similar  argument  regarding  education  i 
discipline,  see  Bowles  and  Gintis,  1977). 

In  terms  of  specific  variables,  none  of  those  measuring  language 
patterns  or  immigration  history  significantly  distinguishes  the  four 
cells  of  the  dependent  variable.  The  only  exception  to  this  pattern 
the  effect  of  non-English-language  background  in  the  equation  for  EM] 
for  whites.  Contrary  to  my  predictions,  Hispanics'  special  circum¬ 
stances  play  no  role  in  explaining  their  school  continuation  or 
employment.  If  these  results  are  to  be  trusted,  this  would  imply  th; 
employers  do  not  find  these  specific  characteristics  relevant  criter: 
on  which  to  base  their  hiring  decisions. 

Finally,  unlike  the  results  for  labor  force  participation,  none  ( 
the  subgroups  is  significantly  different  in  its  employment  behavior. 
Apparently,  the  advantages  that  Cubans  have  in  the  transition  into  tl 
labor  force  do  not  appear  in  employment,  once  the  other  variables  in 
the  model  have  been  controlled. 


Labor  Force  Participation  of  Seniors 

Table  9  shows  the  results  of  the  logistic  regressions  predicting 
labor  force  participation  for  members  of  the  senior  cohort.  As 
mentioned  above,  the  main  differences  between  the  senior  and  sophomo] 
cohorts  are  that  the  seniors  are,  on  average,  two  years  older  than  t] 


Effects  of  Independent  Variables  on  Labor  Force  Participation-School  Enrollment  Status  for 
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sophomores  (compare  Tables  7  and  8)  and  the  seniors  are  all  high  scho< 
graduates;  this  means  that  for  seniors,  school  enrollment  refers  to 
participation  in  postsecondary  education  at  any  time  in  the  two  years 
after  the  base-year  survey. 

Sex  differences  in  labor  force-school  enrollment  status  are  stron< 
for  the  seniors  than  the  sophomores.  Among  Hispanics,  one  effect  of 
sex  appears:  males  are  less  likely  to  be  in  the  labor  force  and  in 
school  (LFPl)  than  females.  Two  sex  differences  surface  as  significar 
predictors  for  whites.  White  males  are  more  likely  than  white  females 
to  be  out  of  the  labor  force  and  in  school  (LFP3)  and  less  likely  to  l 
in  school  and  in  the  labor  force. 

Considering  the  effects  of  the  other  demographic  variables,  maritc 
status  is  a  strong  predictor  of  labor  force  participation  and  post¬ 
secondary  school  enrollment  for  both  whites  and  Hispanics.  Whites  whc 
are  married  are  (in  order)  most  likely  to  be:  (1)  in  the  labor  force 
and  out  of  school  (LFP2) ;  (2)  out  of  the  labor  force  and  out  of  schoo] 
(the  base  category) ;  (3)  in  school  and  in  the  labor  force  (LFPl) ;  or 
(4)  out  of  the  labor  force  and  in  school  (LFP3) .  For  Hispanics,  beinc 
married  clearly  affects  postsecondary  school  attendance:  Hispanics  ai 
most  likely  to  be  in  the  two  out-of-school  categories  (LFP2  and  the 
base  category)  and  least  likely  to  be  in  the  two  in-school  categories 
(LFPl  and  LFP3) • 

Similar  to  the  patterns  for  sophomores'  labor  force  participation, 
family  socioeconomic  background  is  a  significant  predictor  of  both 
white  and  Hispanic  seniors'  labor  force  participation.  For  both  whit< 
and  Hispanics,  respondents  from  more  affluent  families  are  most  likely 
to  be  attending  postsecondary  school  and  not  be  in  the  labor  force 
(LFP3)  and  are  least  likely  to  be  in  the  labor  force  and  out  of  schoo] 
(LFP2) .  Finally,  whites  from  more  affluent  family  backgrounds  have 
higher  chances  of  combining  school  and  labor  force  participation 
(LFPl),  although  this  is  not  as  likely  an  outcome  as  LFP3 . 

The  results  of  the  scholastic-achievement  variables  for  seniors,  i 
contrast  to  the  results  for  sophomores,  reveal  significant  effects  of 
both  test  scores  and  grades.  Test  scores  are  significant  here  probabJ 
because  colleges  routinely  use  performance  on  standardized  tests  (suet 
as  the  Scholastic  Aptitude  Test) ,  which  are  likely  to  be  correlated 
with  the  test  battery  used  in  High  School  and  Beyond,15  as  screening 
devices.  It  is  not  surprising,  then,  that  better  performance  on  the 
standardized  tests  increases  the  probability  of  being  exclusively 
enrolled  in  postsecondary  education  for  whites,  although  the  cor¬ 
responding  effect  for  Hispanics  fails  to  be  significant  (see  equation: 
for  LFP3) .  Better  test  performance  also  serves  to  lower  the  probabil: 
of  respondents'  being  out  of  school  and  in  the  labor  force  for  both 
whites  and  Hispanics  (see  the  equations  for  LFP2) .  But,  whereas 
Hispanics  who  score  well  on  the  standardized  tests  are  more  likely  to 
combine  school  and  labor  force  activity,  whites  are  not  (see  equation: 
for  LFPl)  . 


1  sThe  test  battery  for  High  School  and  Beyond  was  developed  by 
Educational  Testing  Service,  Princeton,  N.J. 
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Independent  of  performance  on  the  tests,  grades  are  a  strong 
predictor  of  school  and  labor  force  activities  for  both  whites  and 
Hispanics.  Here,  too,  the  effect  is  probably  due  to  colleges'  using 
grades  as  an  admittance  criterion.  For  both  whites  and  Hispanics, 
higher  grades  increase  the  chances  of  being  in  either  of  the  in-school 
categories  (LFP1  and  LFP3)  and  decrease  the  chances  of  being  in  either 
of  the  in-labor-force  categories. 

Last  among  the  general  predictors  of  achievement,  previous  work 
experience  has  strong  effects  in  the  expected  directions  for  both 
Hispanics  and  whites.  For  both  groups,  previous  work  experience 
increases  the  likelihood  of  being  in  the  labor  force  regardless  of 
whether  respondents  are  in  school. 

Considering  the  effects  of  the  specific  variables,  among  the 
language  variables,  proficiency  in  English  (as  measured  by  the 
vocabulary  test)  is  unrelated  to  either  postsecondary  attendance  or 
labor  force  participation  for  whites.  However,  English  proficiency 
does  distinguish  among  some  of  the  categories  of  the  dependent  variable 
for  Hispanics.  Greater  English  proficiency  lowers  the  chances  of  being 
in  the  labor  force  and  in  school  (LFP1)  but  increases  the  probability 
of  being  in  school  and  out  of  the  labor  force  (LFP3)  for  Hispanics. 

On  the  other  hand,  proficiency  in  a  non-English  language  shows  some 
effects  for  whites,  but  not  for  Hispanics.  Among  whites,  better  non- 
English  language  proficiency  increases  the  chances  of  combining 
postsecondary  education  and  labor  force  participation  (LFP1)  and 
decreases  the  probability  of  being  out  of  school  and  in  the  labor  force 
(LFP2) . 

The  length-of-residence  variables  indicate  only  two  significant 
effects.  Hispanics  whose  mothers  are  long-time  residents  of  the  United 
States  are  less  likely  to  be  in  school  and  in  the  labor  force  (LFPl) . 
Among  whites,  respondents  who  are  long-time  residents  of  the  United 
States  are  more  likely  to  combine  labor  force  participation  and 
postsecondary  education  (LFPl) . 

Finally,  unlike  the  pattern  in  the  analyses  for  the  sophomores,  the 
dummy  variable  for  the  Puerto  Rican  subgroup  indicates  that  they  are 
significantly  more  likely  than  other  Hispanics  to  be  out  of  the  labor 
force  and  in  school. 


Seniors'  Employment 

Table  10  presents  the  results  of  the  models  of  employment  and 
postsecondary  enrollment  for  seniors.  As  noted  above,  these  estimates 
are  for  respondents  who  are  in  the  labor  force  and  who  are  high  school 
graduates. 

Examining  the  effects  of  the  demographic  variables  indicates  that 
there  is  only  one  effect  of  sex  (on  EMP3  for  Hispanics) .  Among 
Hispanics,  males  are  significantly  more  likely  to  be  unemployed  and  in 
school  than  females. 

There  are  two  significant  effects  of  age,  i.e.,  predicting  EMPl  for 
white  and  predicting  EMP 3  for  Hispanics.  For  whites,  older  respondents 
are  less  likely  to  be  employed  while  in  school.  Among  Hispanics,  older 
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respondents  are  more  likely  to  be  unemployed  while  attending 
postsecondary  education. 

As  has  been  the  case  in  all  the  analyses,  marital  status  emerges  as 
an  important  predictor  of  seniors'  employment  and  school  enrollment. 

For  both  whites  and  Hispanics,  married  respondents  are  less  likely  to 
be  employed  and  in  school  (EMP1)  or  unemployed  and  in  school  (EMP3) . 
However,  this  latter  effect  is  insignificant  for  Hispanics.  For  both 
Hispanics  and  whites,  married  respondents  are  more  likely  to  be 
employed  and  out  of  school  (EMP2) . 

Turning  to  the  effects  of  family  socioeconomic  background,  the 
effects  are  similar  to  those  found  for  labor  force  participation. 

Among  whites,  respondents  from  more  affluent  family  backgrounds  are 
more  likely  to  be  in  the  two  in-school  categories  of  the  dependent 
variable  (EMP1  and  EMP3 )  and  less  likely  to  be  in  the  two  out-of-school 
categories  (EMP2  and  the  base  category) .  The  pattern  is  the  same  for 
Hispanics,  but  the  effect  of  family  background  in  the  equation  for  EMP3 
is  not  statistically  significant. 

Considering  the  effects  of  the  scholastic  achievement  measures,  the 
pattern  for  both  whites  and  Hispanics  is  familiar.  Higher  grade-point 
averages  increase  the  probability  of  being  employed  and  in  school 
(EMP1)  and  lower  the  chances  of  being  employed  and  out  of  school 
(EMP2) .  Better  performance  on  the  test  battery  has  similar  effects. 

As  discussed  above,  these  patterns  are  probably  due  to  college 
selection  criteria. 

The  effects  of  the  final  general  variable  considered — previous  work 
experience — are  also  the  same  as  those  found  in  the  other  analyses. 

For  both  whites  and  Hispanics,  respondents  who  worked  during  the  base 
year  are  more  likely  to  be  employed  and  in  school  (EMP1)  and  less 
likely  to  be  unemployed  and  in  school  (EMP3) . 

Examining  the  specific  variables,  there  is  some  evidence  of  langu¬ 
age  effects  among  whites,  but  not  among  Hispanics.  Among  whites, 
greater  facility  in  a  non-English  language  significantly  increases  the 
chances  of  being  employed  and  in  school  (EMP1)  and  lowers  the  chances 
of  being  employed  and  out  of  school  (EMP2) .  Finally,  English  pro¬ 
ficiency,  as  measured  by  performance  on  the  vocabulary  test,  increases 
the  probability  of  postsecondary  school  enrollment  and  employment 
(EMP1) . 

Among  the  variables  measuring  the  length  of  U.S.  residence,  only 
one  effect  appears  for  Hispanics:  respondents  whose  mothers  are 
long-time  residents  in  the  United  States  are  less  likely  to  be  employed 
and  enrolled  in  school  (EMPl) .  Among  whites,  two  effects  surface, 
i.e.,  respondents  who  are  long-time  U.S.  residents  are  more  likely  than 
recent  immigrants  to  be  employed  and  in  school  (EMPl)  and  less  likely 
to  be  employed  and  out  of  school  (EMP2) . 

Finally,  none  of  the  dummy  variables  for  the  Hispanic  subgroups  is 
significantly  related  to  the  dependent  variable.  This  implies  that  the 
subgroup  differentials  in  unemployment  rates  found  in  Table  4  have  been 
explained  by  the  model. 
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SUMMARY,  CONCLUSION,  AND  POLICY  RECOMMENDATIONS 

The  descriptive  analyses  in  this  paper  have  shown  that  Hispanics 
fare  worse,  overall,  than  whites,  but  not  as  poorly  as  blacks,  in  the 
schools  and  in  the  labor  market.  Hispanic  youths  drop  out  of  high 
school  at  a  higher  rate  than  white  youths  and  a  lower  rate  than  black 
youths.  Similarly,  the  unemployment  rate  for  Hispanic  youths  is  highe 
than  the  rate  for  white  youths  and  lower  than  the  rate  for  black  youth, 
These  statistics  for  the  overall  Hispanic  population  mask  considerable 
heterogeneity  among  the  various  Hispanic  subgroups.  Specifically, 
Cubans  and  other  Latin  Americans  fare  relatively  well  when  compared 
with  whites,  but  Puerto  Ricans  and  Mexican-Americans  fare  relatively 
poorly.  Puerto  Rican  youths  have  particularly  severe  employment 
problems  and  often  have  unemployment  rates  that  are  as  high  as  or 
higher  than  the  rates  for  black  youths. 

The  descriptive  analyses  also  show  that  Hispanic-white  disparities 
in  labor  force  participation  and  unemployment  are  more  severe  among 
high  school  dropouts  than  among  students  in  school.  These  differ¬ 
entials  are  even  smaller  for  the  population  of  high  school  graduates. 

The  multivariate  analyses  that  attempt  to  explain  labor  force 
participation,  unemployment,  and  school  enrollment  for  whites  and 
Hispanics  show  a  number  of  patterns.  For  both  whites  and  Hispanics  in 
the  sophomore  and  senior  cohorts,  family  socioeconomic  background  is 
consistently  related  to  labor  force  participation  and  school  enrollmen 
it  is  related  to  employment  for  seniors,  but  not  for  sophomores.  With 
a  few  exceptions,  the  specific  factors  of  language  and  family- 
immigration  history  are  not  consistently  related  to  school  and  labor 
market  achievements  for  either  Hispanics  or  whites. 

The  two  most  important  determinants  of  labor  force  participation, 
employment,  and  school  continuation  for  both  white  and  Hispanic  youths 
are  scholastic  achievement  and  previous  employment  experience.  For 
both  white  and  Hispanic  sophomores,  grade-point  average  is  a  consisten 
predictor  of  these  school  and  labor  market  variables.  For  seniors, 
both  grades  and  performance  on  standardized  tests  are  related  to  the 
outcome  variables  for  both  whites  and  Hispanics.  Previous  work  experi 
ence  is  also  strongly  related  to  the  dependent  variables  for  both  whiti 
and  Hispanic  youths. 

In  conclusion,  it  appears  that  the  root  of  Hispanic  youths'  labor 
market  problems  lies  in  their  education.  These  results  would  suggest 
that  policy  efforts  should  be  directed  toward  solving  the  problem  of 
Hispanic  underachievement  in  the  schools.  However,  the  positive 
independent  effects  of  previous  work  experience  also  suggest  that  youti 
employment  programs  are  likely  to  have  beneficial  results  for  Hispanic 
youths.  Therefore,  a  two-pronged  approach — through  the  schools  and  in 
the  labor  market — is  likely  to  be  most  fruitful  in  tackling  Hispanic 
youth  employment  problems. 


APPENDIX 


CODING  INFORMATION 

Respondents  are  classified  as  Hispanic  in  this  paper  on  the  basis 
of  their  answer  to  the  following  question  from  the  High  School  and 
Beyond  follow-up  questionnaire:  "What  is  your  origin  or  descent?  (If 
more  than  one,  please  mark  below  the  one  you  consider  the  most  impor¬ 
tant  part  of  your  background)."  Under  the  general  heading  of  "Hispanic 
or  Spanish"  were  grouped  four  possible  answers:  (1)  Mexican,  Mexican- 
American,  Chicano;  (2)  Cuban,  Cubano;  (3)  Puerto  Rican,  Puer toriqueno, 
or  Boricua;  and  (4)  Other  Latin  American,  Latino,  Hispanic,  or  Spanish 
descent.  For  simplicity,  these  have  been  labeled  Mexican-Amer ican, 
Cuban,  Puerto  Rican,  and  other  Latin  American.  Respondents  are 
considered  white  if  their  response  is  something  other  than  Hispanic  to 
the  national-origin  question  and  "white"  to  the  question  "What  is  your 
race?"  Respondents  are  defined  as  black  in  a  similar  fashion.  The 
terms  "white"  and  "black"  as  used  in  this  paper,  then,  refer  to  whites 
and  blacks  not  of  Hispanic  origin.  Hispanics  were  not  differentiated 
further  on  the  basis  of  race,  because  the  distinction  between  concepts 
of  race  and  ethnicity  is  blurred  in  the  case  of  Hispanics.  Many  of  the 
respondents  answered  "Other"  to  the  race  question,  implying  that  they 
view  their  group  as  a  distinct  "race"  (Nielsen  and  Fernandez, 

1982  .-Table  1.3). 

Regarding  the  measurement  of  the  dependent  variables  (labor  force 
participation,  employment,  and  school  enrollment  status),  respondents' 
labor  force  status  is  classified  on  the  basis  of  their  responses  to  the 
following  questions.  Sophomores  were  asked  two  items  in  the  follow-up 
survey:  (1)  "Did  you  do  any  work  for  pay  last  week,  not  counting  work 

around  the  house?"  and  (2)  "Whether  or  not  you  already  have  a  job,  were 
you  looking  for  a  job  last  week?"  Response  categories  of  "Yes"  and 
"No"  were  offered  for  both  questions.  Respondents'  military  enlistment 
(see  Table  3)  was  determined  from  this  question  on  the  dropout  survey: 
"What  were  you  doing  the  first  week  of  February  1982?"  Among  the 
answers  offered  was  "On  active  duty  in  the  Armed  Forces  (or  service 
academy)."  Youths  who  chose  this  option,  regardless  of  their  responses 
on  the  labor  force  status  questions,  are  counted  as  being  enlisted  in 
the  military.  For  the  civilian  population  (i.e.  ,  those  who  did  not 
choose  the  "On  active  duty  in  the  military"  option) ,  respondents  are 
defined  as  employed  if  they  answered  "Yes"  to  question  (1)  above. 
Civilian  respondents  are  classified  as  unemployed  if  they  answered  "No" 
to  question  (1)  and  "Yes"  to  question  (2) .  Civilians  who  answered  "No" 
to  both  questions  are  defined  as  being  out  of  the  labor  force. 

Finally,  school  enrollment  status  for  sophomores  is  based  on  whether 
the  respondent  was  part  of  the  dropout  or  the  in-school  follow-up 
sample . 

Parallel  to  the  sophomores,  senior  cohort  respondents  who  chose  the 
"On  active  duty  in  the  Armed  Forces  (or  service  academy) "  option  of  the 
question  "What  were  you  doing  the  first  week  of  1982?"  are  treated  as 
being  enlisted  in  the  military  (see  Table  5)  ,  regardless  of  their 
choosing  other  employment-  or  school-related  options.  The  employment- 
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related  options  are  (1)  "Working  for  pay  at  a  full-time  or  part-time 
job,"  (2)  "With  a  job  but  on  temporary  layoff  from  work  or  waiting  to 
report  to  work,"  and  (3)  "Looking  for  work."  Civilians  are  classifie 
as  employed  if  they  chose  the  first  option,  unemployed  if  they  chose 
the  second  or  third  option,  and  out  of  the  labor  force  if  they  did  no 
choose  any  of  these  options.  The  school-related  options  were  (1) 
"Taking  academic  courses  at  a  two-  or  four -year  college"  and  (2) 
"Taking  vocational  or  technical  courses  at  any  kind  of  school  or 
college  (for  example,  vocational,  trade,  business,  or  other  career 
training  school)."  Civilian  respondents  are  classified  as  enrolled  i 
postsecondary  education  if  they  chose  either  of  the  school-related 
options,  regardless  of  whether  they  chose  any  of  the  employment-relat 
options. 

The  type  of  postsecondary  school  that  respondents  were  enrolled  i 
(see  Table  4)  was  not  determined  by  the  above  school-related  item. 
Rather,  respondents  were  asked  to  provide  the  names  and  addresses  of 
the  postsecondary  schools  that  they  had  attended  since  leaving  high 
school.  Those  names  and  addresses  were  then  matched  with  data  on  the 
characteristics  of  postsecondary  educational  institutions  (the  1982-1 
Institutional  Characteristics  Survey  of  HEGIS,  Higher  Education  Gener 
Information  Survey,  collected  by  the  National  Center  for  Education 
Statistics) .  These  data  were  used  to  group  respondents  into  the  four 
types  of  postsecondary  school  enrollment.  Note  that  the  data  on  type 
of  postsecondary  enrollment  refer  to  the  school  that  respondents  were 
enrolled  in  at  the  time  of  the  follow-up  survey  (February  1982)  or,  i 
not  enrolled  at  that  time,  the  last  postsecondary  school  they  were 
enrolled  in. 

Regarding  the  measurement  of  family  socioeconomic  status,  the 
variable  is  a  linear  composite  derived  from  measures  of  father's 
occupation,  father's  and  mother's  education,  family  income,  and  a  set 
of  questions  that  ask  whether  the  respondent's  family  receives  a  dail 
newspaper;  whether  the  family  possesses  an  encyclopedia  or  other 
reference  books,  typewriter,  automatic  dishwasher,  two  or  more  cars  o 
trucks,  more  than  50  books,  or  a  pocket  calculator;  and  whether  the 
respondent  has  his  or  her  own  room.  Coding  on  this  variable  is  based 
on  a  linearly  weighted  combination  of  the  above  family  background 
measures,  where  the  weights  are  derived  from  the  non-missing  data.  I 
a  case  has  missing  data  on  any  of  these  background  variables,  the 
composite  is  computed  from  the  non-missing  data  for  that  case  (see 
Jones  et  al.,  1983:62). 

Grades  are  measured  by  the  question,  "Which  of  the  following  best 
describes  your  grades  so  far  in  high  school?"  Eight  response  categor 
were  offered  from  "Mostly  A"  (a  numerical  average  of  90  to  100)  to 
"Mostly  below  D"  (below  60)  .  The  variable  was  recoded  on  a  four-poin 
scale  so  that  "Mostly  A"  is  assigned  "4,"  "About  half  A  and  half  B"  i 
coded  "3.5,"  and  so  on,  down  to  "Mostly  below  D,"  which  is  coded  ".5. 

The  standardized  test  scores  used  in  these  analyses  are  a  composi 
of  reading,  vocabulary,  and  mathematics  tests  administered  during  the 
base-year  survey  [see  Heyns  and  Hilton  (1982)  for  a  detailed  discussi 
of  the  High  School  and  Beyond  cognitive  tests] .  For  both  the  sophomc 
and  senior  cohorts,  each  individual  test  was  standardized  within  cohc 
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to  have  a  mean  of  50  and  a  standard  deviation  of  10.  For  sophomores, 
the  composite  was  computed  by  taking  the  mean  of  the  non-missing  test 
scores.  This  procedure  was  slightly  modified  for  seniors  because  they 
were  administered  two  vocabulary  tests.  Items  from  the  two  vocabulary 
tests  were  combined  before  the  vocabulary  test  was  standardidized  (see 
Jones  et  al.f  1983:Section  6.9).  The  test  composite  was  then  computed 
by  taking  the  mean  of  the  standardized  non-missing  reading,  vocabulary, 
and  mathematics  test  scores. 

Regarding  the  demographic  variables  (i.e.,  age,  sex,  and  marital 
status),  age  and  sex  were  measured  by  base-year  items.  However,  because 
marital  status  was  not  measured  directly  in  the  base-year  survey  for 
seniors,  a  question  from  the  follow-up  survey  was  used:  "What  was  your 
marital  status  the  first  week  of  February  1982?"  Responses  were  recoded 
so  that  1  =  ever  married  (i.e.,  married,  divorced,  separated,  widowed) 
and  0  =  never  married.  Because  sophomores  were  not  asked  their  marital 
status  directly  in  either  the  base-year  or  follow-up  surveys,  the 
following  question  from  the  follow-up  survey  was  used  to  distinguish 
respondents  who  had  been  married  from  those  who  had  not  been  married. 
Respondents  were  presented  a  question  worded  "At  what  age  do  you  expect 
to  . .  .  ,"  which  was  completed  with  a  number  of  items,  including  "Get 
Married?"  Among  the  response  categories  for  this  question  is  "Have 
already  done  this."  Respondents  who  chose  this  response  to  the  "Get 
Married"  item  were  coded  in  parallel  fashion  to  the  seniors,  i.e.,  1  = 
ever  married,  versus  0  =  never  married  for  those  who  did  not  choose 
this  response. 

Both  sophomores  and  seniors  were  asked,  "Did  you  do  any  work  for 
pay  last  week,  not  counting  work  around  the  house?"  Responses  of  "yes" 
and  "no"  were  offered  and  are  coded  here  as  one  and  zero,  respectively. 

Regarding  parent's  length  of  U.S.  residence,  students  were  asked  in 
the  base-year  survey  how  much  of  their  mother's  and  father's  lives  have 
been  spent  in  the  United  States.  Each  variable  had  five  response  cate¬ 
gories:  (1)  about  1-5  years;  (2)  about  6-10  years;  (3)  about  11-20 

years;  (4)  more  than  20  years,  but  not  all;  and  (5)  all  or  almost  all. 
Categories  (1)  through  (3)  were  recoded  to  the  midpoint  (3,  8,  and  15.5 
years,  respectively).  Categories  (4)  and  (5)  presented  more  of  a  prob¬ 
lem  because  they  implicitly  refer  to  the  parent's  age,  for  which  High 
School  and  Beyond  does  not  have  a  measure.  The  values  for  these  two 
categories  were  imputed  by  using  the  modal  age  of  mother's  childbearing 
(25)  and  adding  the  student's  modal  age  (15  for  sophomores  and  17  for 
seniors)  and  assigning  that  to  the  fifth  ("All  or  almost  all")  cate¬ 
gory.  Therefore,  the  value  imputed  for  sophomores  is  40  and  for 
seniors,  42.  The  midpoint  of  the  fourth  category  then  became  defined 
as  29  years  for  sophomores  and  31  years  for  seniors.  This  procedure 
was  repeated  for  father's  length  of  residence,  but  three  years  were 
added  to  account  for  a  typical  three-year  difference  in  age  between 
husbands  and  wives.  Thus,  the  fourth  and  fifth  categories  for  father's 
length  of  residence  were  recoded  to  43  and  30.5,  respectively,  for 
sophomores,  and  45  and  32.5  for  seniors. 

Students  were  also  asked  to  report  how  much  of  their  lives  had  been 
spent  in  the  United  States.  The  response  categories  were  (1)  about  1-5 
years;  (2)  about  6-10  years;  (3)  more  than  10  years,  but  not  all;  and 
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(4)  all  or  almost  all.  Since  available  data  included  the  student's 
age,  all  the  categories  were  well  defined  and  recoded  as  follows;  (l 
3  years;  (2)  8  years;  (3)  (10  +  student's  age)/2;  and  (4)  student's 
age.  If  the  student's  age  was  not  available,  it  was  imputed  for  use 
the  student  length-of-residence  variable  as  the  modal  age — for 
sophomores  15  and  for  seniors  17.  This  was  done  for  only  a  few  cases 

Language  questions  were  administered  through  a  separate  question¬ 
naire  to  all  respondents  (i.e.,  not  just  Hispanics)  who  passed  a  filti 
of  five  questions  that  asked  about  the  respondent's  mother  tongue  and 
languages  presently  spoken  at  home.  Those  students  who  reported  a 
language  other  than  English  in  response  to  one  of  the  five  questions 
regarding  language  background  were  asked  to  choose  on  a  four-point 
scale  how  well  they  understood,  spoke,  read,  and  wrote  the  non-Englisl 
language.  The  response  categories  are  "Not  at  All,"  "Not  Very  Well," 
"Pretty  Well,"  and  "Very  Well"  and  were  coded  from  zero  to  four. 
Exploratory  factor  analysis  of  the  survey's  pretest  data  showed  that 
the  four  items  clearly  load  on  one  factor,  with  each  of  the  indicators 
contributing  equally  (see  Fernandez,  1980).  The  composite  index  was 
formed  by  taking  the  mean  of  the  four  items.  Note  that  the  coding  is 
positive,  ranging  from  a  low  of  zero  (indicating  no  proficiency  in  th< 
other  language)  to  a  high  of  three  (indicating  high  proficiency) . 
Those  students  who  did  not  pass  the  language  background  filter  (i.e., 
were  monolinguals)  were  assigned  a  zero  on  the  scale  for  proficiency  j 
non-English  language.  When  combined  with  the  dummy  variable  for 
language  background,  this  coding  has  the  effect  of  creating  a  spline 
for  the  prof iciency- in-other-language  scale. 

English  proficiency  is  measured  by  the  student's  performance  on  tt 
base-year  standardized  vocabulary  test.  To  simplify  across-cohort 
comparisons,  the  scores  used  are  based  on  the  subset  of  test  items  the 
were  identical  in  the  sophomore  and  senior  test  batteries.  The  test  if 
standardized  to  a  mean  of  50  and  a  standard  deviation  of  10. 
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The  Participation  of  Young  Women  in 
Employment  and  Training  Programs 

Margaret  Simms 


When  the  federal  government  initiated  employment  and  training 
programs  in  the  1960s,  the  focus  was  on  assisting  adult  males  who  h 
been  displaced  from  their  jobs  by  technological  change  or  who  were 
structurally  unemployed.  Even  in  youth  programs,  where  displacemen 
and  long-term  unemployment  were  less  important,  the  emphasis  was  on 
males.  It  was  thought  that  their  employment  needs  were  greater  and 
that  unemployment  was  likely  to  lead  to  criminal  behavior  among  youi 
men,  but  not  among  young  women. 

Over  time,  the  economic  needs  of  women,  especially  young  women, 
became  an  issue.  Increased  labor  force  participation  by  women  and 
"feminization  of  poverty"  made  policymakers  and  others  aware  of  the 
importance  of  providing  meaningful  employment  and  training  opportun 
to  young  women.  This  interest  has  been  reinforced  by  studies  that 
indicate  that  unemployment  among  young  women  can  have  a  deleterious 
effect  on  their  future  employment  and  earnings  (Taggart  and  Linder, 
1980).  In  the  absence  of  intervention,  however,  many  young  women  w 
not  have  favorable  labor  market  experiences.  This  is  especially  tr 
for  black  women;  the  data  indicate  that  labor  force  and  employment 
conditions  for  black  teenage  women  have  been  deteriorating  over  the 
past  25  years  (Stormsdorfer ,  1980;  Swinton  and  Morse,  1983). 

This  paper  reviews  the  participation  of  young  women  in  employme 
and  training  programs.  The  first  section  describes  the  variety  of 
programs  that  youths  have  participated  in,  the  level  of  participati 
by  young  women,  and  the  characteristics  of  young  female  participant 
compared  with  their  male  counterparts.  The  second  section  reviews 
type  of  service  received  by  participants  and  examines  program 
outcomes.  The  final  section  summarizes  the  findings  and  suggests 
subjects  for  additional  research. 


Margaret  C.  Simms  is  director  of  the  Minorities  and  Social  Poli 
Program  at  The  Urban  Institute.  The  opinions  expressed  in  this  pap 
are  the  sole  responsibility  of  the  author  and  do  not  necessarily 
represent  the  views  of  The  Urban  Institute  and  its  sponsors. 
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YOUTH  PARTICIPATION  IN  EMPLOYMENT  AND  TRAINING  PROGRAMS 

The  federal  government's  post-World  War  II  involvement  in  employ¬ 
ment  and  training  programs  began  with  the  Manpower  Development  and 
Training  Act  (MDTA)  of  1962.  Government  training  programs  designed 
especially  for  youths  started  with  the  creation  of  the  Neighborhood 
Youth  Corps  (NYC)  and  the  Job  Corps  through  the  Economic  Opportunity 
Act  of  1964.  When  the  Comprehensive  Employment  and  Training  Act  (CETA) 
was  passed  in  1973,  most  of  the  existing  youth  programs  were  included 
in  the  consolidation  of  employment  and  training  activities  although 
they  remained  separate  activities.  In  1977  the  Youth  Employment  and 
Demonstration  Projects  Act  (YEDPA)  added  additional  programs  targeted 
on  youths.  This  legislation  expired  in  1981  and  all  youth  training 
programs  were  subsumed  under  the  Job  Training  Partnership  Act  (JTPA)  in 
1982.  (Job  Corps  and  the  Summer  Youth  Employment  Program  (SYEP)  are 
separate  programs  under  JTPA. ) 

Young  people  have  not  only  enrolled  in  youth  programs  but  have  also 
participated  in  the  full  range  of  employment  and  training  programs 
since  the  mid-1960s.  Between  1965  and  1972  youths  were  between  20  and 
nearly  50  percent  of  enrollees  in  such  programs  as  the  Puolic 
Employment  Program,  the  Work  Incentive  Program  (WIN) ,  MDTA,  Job 
Opportunities  in  the  Business  Sector  (JOBS) ,  and  the  Concentrated 
Employment  Program  (CEP) .  Youths  (under  age  22)  constituted  between  48 
and  62  percent  of  enrollees  in  CETA  Title  I  in  the  years  1975  to  1981 
and  more  than  20  percent  of  enrollees  in  Titles  II  and  VI  during  the 
same  years .  1 


Female  Participation 

Studies  of  participation  in  employment  and  training  programs  by 
women  indicate  that  women  have  not  been  treated  equally  over  the 
history  of  these  programs.  Between  fiscal  1965  and  fiscal  1978,  women 
were  less  than  one-half  of  program  participants  (Harlan,  1980) .  In 
fiscal  1978  women  were  45  percent  of  enrollees  in  locally  operated 
programs.  By  the  last  quarter  of  fiscal  1979,  women  were  more  than  50 
percent  of  enrollees  in  all  local  programs  except  on-the-job  training. 
Very  few  studies  have  focused  exclusively  on  participation  by  young 
women,  but  estimates  of  their  participation  can  be  constructed  from 
data  on  youth  programs  and  from  female  and  youth  participation  in  adult 
programs. 

Table  1  shows  female  participation  in  youth  programs  prior  to  the 
1973  passage  of  CETA  and  for  selected  programs  under  CETA  and  YEDPA. 
Before  1973,  the  largest  youth  program  was  the  Neighborhood  Youth 


xAfter  1979,  Titles  I,  II,  and  VI  should  be  interpreted  as  Titles 
II-B  and  C,  II-D,  and  VI,  respectively.  No  data  are  yet  available  on 
JTPA  enrollment.  See  Burbridge  (1983)  for  a  history  of  youth 
participation  in  employment  and  training  programs. 


TABLE  1  Female  Participation  in  Selected  Youth  Programs,  1965-1980 


percentage  Female 
1965- 

1972  1978 

1980 

1965-1972 

Neighborhood  Youth  Corps 

In-school  youths 

Out-of-school  youths 

Job  Corps 

45.2 

47.7 

27.0 

1978-1980 

Job  Corps 

29.0 

NA 

Youth  Employment  and  Training  Programs 
Youth  Community  and  Conservation 

51.3 

52.5 

Improvement  Projects 

24.8 

24.8 

Summer  Youth  Employment 

51.4 

48.1 

SOURCES s  L.C.  Burbridge  (1983)  and  S.E.  Berryman,  W.K.  Chow,  and 
R.M.  Bell  (1981) . 


Corps.  Over  4.5  million  youths  enrolled  in  NYC  between  1965  and  1972 
and  between  45  and  48  percent  of  them  were  young  women.  In  the  much 
smaller,  residential  Job  Corps  program,  young  women  were  only  27 
percent  of  enrollees.  By  1978,  women  were  51  percent  of  enrollees  ir 
the  summer  youth  program  (SYEP)  and  in  Youth  Employment  and  Training 
Programs  (YETP) ,  but  still  lagged  in  Job  Corps  enrollment.  Even  so, 
they  may  still  have  been  underrepresented  in  SYEP  and  YETP,  since  it 
estimated  that  they  were  54  percent  of  the  eligible  population  (Berry 
et  al. ,  1981) .  Female  enrollment  in  Youth  Community  Conservation  anc 
Improvement  Projects  (YCCIP)  was  only  24.8  percent  in  both  1978  and 
1980,  although  it  is  estimated  that  young  women  were  about  46  percent 
of  the  eligible  population  for  YCCIP.  This  discrepancy  is  thought  tc 
be  due  to  sexual  stereotyping,  since  YCCIP  involved  intensive  manual 
labor,  more  so  than  did  other  programs  (Burbridge,  1983). 

Overall,  young  women  have  done  slightly  better  than  adult  women  i 
terms  of  participation  in  employment  and  training  programs.  However, 
this  is  primarily  the  result  of  their  greater  representation  in  youth 
programs.  In  adult  CETA  programs,  women  have  been  a  smaller  proporti 
of  enrollees  under  age  22  than  they  have  been  of  enrollees  aged  22  ar 
over  (Table  2) . 

An  examination  of  the  enrollment  of  youths  in  CETA  and  other  emp] 
ment  and  training  programs  by  race  and  sex  reveals  some  minor  differ¬ 
ences  by  sex,  but  far  less  than  might  be  expected.  Data  from  the  19" 
Continuous  Longitudinal  Manpower  Survey  (CLMS)  and  Current  Populatior 
Survey  (CPS)  reveal  that  women  were  just  under  47  percent  of  the 


Aged  22  and  Over 


Under  Age  22 


Title 

I 

52.5 

48.1 

Title 

II 

41.6 

34.7 

Title 

VI 

37.4 

Total 

45.5 

48. 6a 

aIncludes  Summer  Youth  Employment  Program,  Youth  Community 
Conservation  and  Improvement  Projects,  and  Youth  Employment  and 
Training  Projects. 

SOURCE:  S.E.  Berryman,  W.K.  Chow,  and  R.M.  Bell  (1981). 


enrollees  in  CETA  programs  and  50.3  percent  of  the  youth  population 
(aged  22  and  under)  (Table  3).  Most  of  the  discrepancy  was  among  white 
women,  whose  participation  in  CETA  was  well  below  that  of  white  men. 
Black  and  Hispanic  women,  whose  CETA  participation  exceeded  their 
representation  in  the  population,  participated  at  rates  comparable  to 
those  of  their  male  counterparts.  The  National  Longitudinal  Survey 
(NLS)  of  Young  Americans  (see  Borus,  1983:120)  produced  roughly 
comparable  estimates  of  participation  in  all  government  employment  and 
training  programs  by  youths  between  the  ages  of  14  and  21  during  1978 
and  early  1979. 


Characteristics  of  Program  Participants 

In  addition  to  concern  over  their  lower  participation  in  government- 
sponsored  employment  and  training  programs,  it  has  been  said  that  the 
young  women  are  better  qualified  than  the  young  men  who  enter  the 
programs.  This  may  occur  because  there  is  more  "creaming"  among  women 
than  among  men.  In  creaming,  the  program  sponsor  selects  those 
applicants  who,  in  the  sponsor's  view,  are  the  best  qualified  of  those 
eligible  to  participate  in  the  program.  The  young  women  who  are 
selected  into  the  program  may  have  to  meet  higher  standards  in  terms  of 
education  or  prior  experience.  However,  there  could  also  be  differences 
between  young  men  and  young  women  in  terms  of  who  chooses  to  apply  for 
the  employment  and  training  programs.  For  example,  if  young  women  have 
different  perceptions  about  their  likely  participation  in  the  labor 
force  as  adults,  they  might  also  differ  in  their  interest  in  enrolling 
in  employment  and  training  programs.  In  a  study  done  for  The  Rocke¬ 
feller  Foundation,  The  Urban  Institute  examined  the  characteristics  of 
young  women  who  participated  in  employment  and  training  programs  and 
compared  them  with  the  characteristics  of  young  men  who  participated 


TABLE  3  Percentage  Distribution  in  the  CLMS  and  CPS  Populations  by  I 
and  Sex  for  Individuals  Under  Age  23,  Fiscal  1977 


Percentage 

Females 

of  CLMS 

Males 

Percentage 

Females 

White 

17.80 

24.16 

40.48 

Black 

23.18 

23.93 

6.94 

Hispanic 

5.94 

4.96 

2.92 

Total 

46.92 

53.05 

50.34 

NOTE:  These  calculations  exclude  other  minorities  (i.e.,  nonblack, 
non-Hispanic  minority  groups). 

SOURCE:  Data  from  L.J.  Bassi,  M.C.  Simms,  L.C.  Burbridge,  and  C.L.  I 
(1984)  . 


and  nonparticipant  youths.  The  objective  of  the  study  was  to  identiJ 
possible  differences  and  to  determine  which  differences,  if  any, 
affected  the  probability  of  participation  in  government-sponsored 
employment  and  training  programs  (Simms  and  Leitch,  1983)  . 

The  Urban  Institute  study  was  based  on  data  from  the  National 
Longitudinal  Survey  of  Young  Americans.  The  NLS  is  a  good  data  set  1 
analyzing  youth  participation  in  employment  and  training  programs 
because  it  allows  one  to  compare  participants  with  nonparticipants. 
The  data  set  includes  more  than  12,000  individuals  aged  14  to  21  in 
1979.  The  survey  oversampled  minorities  and  low-income  whites,  the 
groups  most  likely  to  participate  in  employment  and  training  program; 
Just  over  2,000  respondents  had  participated  in  at  least  one  governm* 
sponsored  employment  and  training  program  prior  to  the  1980  survey 
interviews.  Although  participation  rates  were  higher  among  minority 
groups — one-third  of  the  blacks  interviewed  had  participated  in  a 
program,  compared  with  11  percent  of  whites  and  24  percent  of 
Hispanics — there  were  no  substantial  differences  by  sex  (Table  4) . 

In  general,  young  women  in  the  sample  had  higher  levels  of 
educational  attainment  than  young  men.  Overall,  young  men  in  the 
sample  were  more  likely  to  have  less  than  a  high  school  education  (4 
percent  of  the  men  versus  44.5  percent  of  the  females  in  the  sample) 
and  were  less  likely  to  have  completed  any  formal  education  beyond  h. 
school  (19.2  percent  for  males  versus  23.8  percent  for  females)  (see 
Table  5).  This  differential  was  similar  for  all  ethnic  groups,  exce] 
Hispanics.  For  those  who  had  participated  in  government  programs,  t 
educational  gap  was  much  wider.  Among  participants  between  January 
1978  and  spring  1980,  there  were  large  differences  between  men  and 
women;  a  larger  percentage  of  the  female  than  the  male  participants  ] 
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TABLE  4  Percentage  of  the  Population  Participating  in  Employment 
and  Training  Programs  Prior  to  1980 


Men 

Women 

Single 

Program 

Multiple 

Programs 

Total 

Single 

Program 

Multiple 

Programs 

Total 

White 

7.6 

3.3 

10.9 

7.5 

3.8 

11.3 

Black 

21.3 

11.8 

33.1 

19.6 

12.3 

31.9 

Hispanic 

13.4 

10.7 

24.1 

15.1 

8.3 

23.4 

Other 

12.0 

5.1 

17.1 

7.6 

5.2 

12.8 

NOTE;  Based  on  National  Longitudinal  Survey  sample  of  youths  aged  14 
to  21  who  answered  this  question. 

SOURCE;  M.C.  Simms  and  M.L.  Leitch  (1983) . 


completed  high  school  and  acquired  some  college  education.  With  the 
exception  of  Hispanics,  the  gender  differences  in  educational  attainment 
were  greater  for  government-program  participants  than  for  nonpartici¬ 
pants  . 

Educational  gaps  are  also  apparent  when  another  data  set  is  used. 

For  example,  a  comparison  of  1977  youth  enrollees  in  CETA  with  youths 
in  the  Current  Population  Survey  reveals  that  while  young  men  in 
general  were  more  likely  to  be  high  school  dropouts,  the  differences 
between  men  and  women  in  CETA  programs  were  somewhat  greater,  at  least 
among  whites;  white  male  enrollees  had  dropout  rates  that  were  at 
least  twice  as  high  as  those  of  white  women  who  were  enrolled  in  CETA 
programs  (Bassi  et  al. ,  1984) . 

To  investigate  the  possibility  that  young  women  who  entered 
government  programs  had  different  qualifications  because  of  differences 
in  willingness  to  participate  in  the  program,  Simms  and  Leitch  (1983) 
analyzed  the  attitudes  of  young  women  toward  work  as  part  of  the 
Rockefeller  study.  Since  young  women  have  two  options  not  available  to 
young  men — childbearing  and,  generally,  work  in  the  home — young  women 
as  a  group  might  be  less  interested  in  employment  and  training 
programs.  Researchers  had  hypothesized  that  women  who  participate  in 
employment  and  training  programs  have  less  traditional  attitudes  than 
nonparticipants  and  are  also  more  likely  to  expect  to  be  in  the  labor 
market  for  most  of  their  adult  years.  This  was  the  case  for  women  who 
participated  in  programs  prior  to  1978.  However,  since  it  is  possible 
that  program  participation  and  maturation  affected  their  attitudes,  it 
is  more  useful  to  concentrate  on  those  who  participated  after  January 
1978,  since  the  information  available  on  respondents'  attitudes  is  most 
likely  to  precede  participation.  Here  we  find  that  women  who  were 
participants  in  government  programs  after  1977  were  no  less  likely  to 
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TABLE  5  Highest  Grade  Completed,  by  Sex,  1979 


Males 

Females 

Total  Sample 

100. 0a 

100. 0£ 

Less  than  high  school 

49.2 

44.5 

High  school 

31.5 

31.8 

More  than  high  school 

19.2 

23.8 

Enrollees  in  Government  Programs  after  1977 

100.0 

100.0 

Less  than  high  school 

80.4 

69.4 

High  school 

8.9 

27.8 

More  than  high  school 

10.7 

2.8 

NOTE:  Based  on  National  Longitudinal  Survey  sample  of  youths  aged  14 
to  21  who  answered  this  question. 

aTotals  do  not  add  to  100.0  due  to  rounding. 

SOURCE:  M.C.  Simms  and  M.L.  Leitch  (1983)  . 


think  that  a  woman's  place  is  in  the  home  than  were  women  who  did  not 
participate  in  training  programs.  And  they  were  more  likely  to  think 
that  a  woman's  place  is  in  the  home  than  those  who  participated  in 
private  or  military  training  programs  (Table  6).  However,  when  askec 
what  they  expect  to  be  doing  at  age  35,  government-program  participar 
were  more  likely  to  say  "working,"  indicating  that  they  expect  econon 
reality  to  be  a  factor  in  their  actions. 

Another  factor  that  might  affect  participation  by  young  women  is 
family  responsibilities.  Young  women  with  children  or  other  family 
responsibilities  may  not  be  able  to  participate  in  programs,  either 
because  they  lack  child  care  or  because  they  cannot  take  time  away  fi 
nonmarket  work.  In  1979  the  vast  majority  of  the  respondents  in  the 
NLS  sample  lived  with  their  parents.  Young  women,  however,  were  less 
likely  to  live  with  their  parents  than  young  men  and  were  more  likely 
to  be  married  or  living  on  their  own.  There  were  large  racial 
differences  in  living  arrangements  beginning  at  age  18;  blacks  of  bot 
sexes  were  much  less  likely  to  live  on  their  own  than  members  of  oth€ 
racial  or  ethnic  groups. 

The  women  in  the  sample,  both  married  and  unmarried,  were  much  me 
likely  to  have  children  than  the  men  in  the  sample;  17  percent  of  the 
women  in  the  sample  had  at  least  one  child,  compared  with  6.9  percent 
of  the  men.  There  were  496  women  in  the  sample  who  were  heads  of 
households  (7.8  percent  of  all  women  in  the  sample). 

Participants  in  government  training  programs  were  no  more  likely 
be  married  than  participants  in  the  sample  as  a  whole.  They  were, 
however,  more  likely  to  have  children.  A  significant  proportion  of 
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TABLE  6  Women's  Responses  to  Statement  "A  Woman's  Place  Is  in  the 
Home,"  by  Participant  Status  (in  percentages) 


Time  and 

Strongly 

Strongly 

Participant  Status 

Disagree 

Disagree 

Agree 

Agree 

Pre-1978 

Nonpar ticipantsa 
Participants  in  other 

39.5 

44.5 

11.6 

4.3 

training  programs 
Participants  in 

41.1 

47.3 

8.5 

3.1 

government  programs 

46.7 

42.4 

7.3 

3.6 

Post-1978 

Nonparticipants 
Participants  in  other 

39.0 

44.8 

11.7 

4.5 

training  programs 
Participants  in 

53.4 

39.3 

5.9 

1.4 

government  programs 

39.3 

45.5 

10.7 

4.5 

NOTES:  Based  on  National  Longitudinal  Survey  sample  of  youths  aged  14 
to  21  who  answered  this  question. 

aTotals  do  not  add  to  100.0  due  to  rounding. 

SOURCE:  M.C.  Simms  and  M.L.  Leitch  (1983)  . 


women  who  were  heads  of  households  had  participated  in  some  type  of 
employment  or  training  program. 

The  last  phase  of  the  study  of  the  determinants  of  participation  in 
employment  and  training  programs  was  a  multivariate  analysis.  The  main 
objective  of  this  analysis  was  to  determine  which  factors  are  likely  to 
affect  participation  in  employment  and  training  programs,  whether  those 
factors  differ  for  men  and  women,  and  whether  after  adjusting  for  all 
the  relevant  factors  there  is  still  a  sex  differential.  Included  in 
the  regression  analysis  were  independent  variables  in  six  broad 
categories:  (1)  background  and  demographic  characteristics,  (2) 

education,  (3)  family  responsibilities  and  attitudes,  (4)  financial 
need,  (5)  work  experience  (including  prior  participation  in  training 
programs) ,  and  (6)  local  employment  conditions. 

Based  on  past  studies  of  women's  participation  in  adult  programs, 
we  expected  to  find  that  young  women  were  less  likely  to  participate  in 
employment  and  training  programs  and  that  young  women  who  did  partici¬ 
pate  in  programs  were  likely  to  be  better  qualified  than  their  male 
counterparts.  In  our  regression  analysis,  we  found  some  evidence  to 
indicate  that  young  women  were  less  likely  to  be  enrolled  in 
government-sponsored  employment  and  training  programs,  other  things 


clear.  In  equations  that  did  not  include  participation  prior  to  197 £ 
as  an  independent  variable,  the  coefficient  for  sex  was  negative  and 
significant.  Once  prior  participation  was  entered  into  the  equation, 
the  coefficient  for  sex,  while  still  negative,  became  insignificant. 
The  interpretation  of  this  finding  is  not  obvious.  On  the  one  hand, 
may  mean  that  previous  participants  in  programs  were  more  adept  at 
obtaining  a  slot  in  another  program,  and  since  women  were  less  likely 
to  have  had  that  prior  experience,  they  fared  worse  than  their  male 
counterparts.  On  the  other  hand,  it  may  mean  that  sex  differences  ir 
participation  continue  to  exist  and  are  similar  in  nature  to  those  ir 
existence  prior  to  1978  and  the  lagged  variable  is  picking  up  this 
connection. 

To  the  extent  that  it  exists,  differential  participation  by  womer 
does  not  seem  to  be  related  to  perceptions  about  future  participatior 
in  the  labor  market.  None  of  the  variables  that  were  used  to  measure 
work  expectations  proved  to  be  significant.  In  contrast  to  women  whc 
entered  private  or  military  training,  women  in  government  programs  we 
no  less  likely  than  nonparticipants  to  think  that  a  woman's  place  is 
the  home.  Therefore,  there  is  no  evidence  to  indicate  that  women  whc 
enter  government  programs  have  expectations  of  greater  labor  force 
attachment  than  those  who  do  not  or  that  different  attitudes  about  w< 
might  explain  why  there  are  differences  in  participation  between  your 
men  and  young  women.  The  presence  of  dependents  is  negatively 
correlated  with  participation  for  both  men  and  women. 

In  general,  the  variables  that  are  important  in  explaining 
participation  are  the  same  for  men  and  for  women.  For  the  most  part; 
the  relationships  are  consistent  with  a  "scraping"  hypothesis  rather 
than  a  "creaming"  hypothesis.  The  probability  of  participation  is 
negatively  correlated  with  total  family  income  and  socioeconomic  stal 
(measured  by  father's  education).  It  is  positively  correlated  with 
prior  enrollment  in  remedial  education,  with  the  number  of  periods  oJ 
no  work,  with  the  number  of  months  on  welfare  (for  women)  ,  and  with 
being  black  or  Hispanic.  We  found  no  evidence  to  indicate  that  the 
women  who  entered  government  programs  were  better  qualified  than  thei 
male  counterparts. 


PROGRAM  TREATMENT  AND  PROGRAM  OUTCOMES 

An  analysis  of  female  participation  in  employment  and  training 
programs  would  be  incomplete  without  an  assessment  of  the  treatment 
young  women  receive,  how  it  differs  from  that  of  young  men,  and  the 
effects  of  those  treatments  on  some  set  of  outcomes.  This  section 
focuses  on  analyses  that  have  been  done  in  this  area.  Although  a 
variety  of  data  sources  were  used,  most  analyses  relied  on  informati< 
available  from  the  CLMS  and  from  the  1979  NLS  because  those  data  set: 
include  enrollees  in  different  types  of  employment  and  training 
programs  and  also  provide  information  on  groups  who  have  not 
participated  in  programs. 


TABLE  7  Summary  of  Ordinary  Least-squares  Runs  on  participation  in  Government 
Training,  Post-1978,  With  Lagged  Participation  Variables 


Full  Sample 

Males 

Females 

F 

F 

F 

Ba  Statistic 

B 

Statistic 

B  Statistic 

AGE79b 

- .  014 

15.55* 

-.017 

13.35* 

-.009 

2.93** 

BLACK 

.101 

74.89* 

.092 

31.18* 

.111 

43.84* 

HISPANIC 

.062 

19.36* 

.032 

2.62 

.090 

20.47* 

OTHERACE 

-.011 

0.36 

.006 

0.05 

.023 

0.81 

FAMINCOME 

-.003 

38.36* 

-.003 

28.98* 

-.002 

9.52* 

SEX 

-.011 

1.37 

— 

— 

— 

— 

EMPLOYRATE1 

.011 

1.55 

.014 

1.16 

.008 

0.35 

EMPLO YRATE  2 

.101 

10.90* 

.113 

7.08* 

.096 

4 ,74*** 

MARRIED 

.047 

1.34 

-.063 

0.90 

-.038 

0.53 

DIVORCED 

-.091 

3.46** 

-.089 

0.92 

-.090 

2.37 

DEPENDENTS 

-.058 

9.82* 

-.043 

3.03** 

-.078 

7.66* 

HIGHGRADE1 

-.023 

2.35 

-.025 

1.47 

-.022 

1.10 

HIGHGRADE2 

-.017 

0.67 

-.030 

1.10 

-.010 

0.13 

WORKEXPECT 

-.001 

0.00 

-.018 

0.39 

.018 

0.42 

NOWORK 

.041 

58.17* 

.038 

28.30* 

.043 

28.14* 

LIVEWITHl 

-.024 

0.82 

-.048 

1.55 

.006 

0.03 

LIVEWITH2 

-.013 

0.09 

-.041 

0.46 

.023 

0.15 

LIVEWITH3 

-.080 

9.91* 

-.122 

11.08* 

-.035 

0.97 

FATHERGRAD1 

-.031 

7.76* 

-.033 

4.67*** 

-.029 

3.39** 

F ATHERGRAD  2 

-.042 

9.69* 

-.042 

5.08*** 

-.046 

5 .49*** 

MOTHERWORK1 

-.011 

0.77 

.002 

0.01 

-.027 

2.20 

MOTHERWORK2 

-.001 

0.00 

.013 

0.44 

-.016 

0.64 

FEMALEWK14 

-.027 

5.65*** 

-.023 

2.04 

-.030 

3.45** 

FAMILYATT 

.001 

0.01 

.002 

0.05 

-.002 

0.05 

REMEDIAL 

.036 

8.25* 

.  023 

1.97 

.053 

7.57* 

MOSWELFARE 

.006 

4.69*** 

.003 

0.25 

.007 

4.69*** 

GOVTPRE78 

.219 

214.62* 

.216 

112.87*** 

.220 

97.52* 

PRIVPRE7  8 

.025 

0.88 

.013 

0.12 

.042 

1.21 

CONSTANT 

0 

.478 

0 

.596 

0 

.318 

NUMBER 

6 

,172 

3 

,208 

2 

,964 

R2 

.14 

.15 

.13 

*F  significant  at  .01  level. 
**F  significant  at  .10  level. 
***F  significant  at  .05  level. 


aUnstandardized  coefficient. 

^Variable  names  on  following  page. 

SOURCE:  M.C.  Simms  and  M.L.  Leitch  (1983)  . 


AGE79 

respondent's  age  in  1979 

BLACK 

HISPANIC 

OTHERACE 

respondent's  race;  white  is  the  omit 
var iable 

FAMINCOME 

total  family  income  of  respondent's 
household  in  1978 

SEX 

respondent's  sex 

EMPLOYRATE1 

EMPLOYRATE  2 

1979  unemployment  rate  for  labor  mar 
of  current  residence;  rates  under  6 
percent  is  omitted  variable 

MARRIED 

DIVORCED 

marital  status,  single  is  omitted 
var iable 

DEPENDENTS 

number  of  dependents  in  1978 

HIGHGRADE1 

HIGHGRADE2 

highest  grade  completed  by  responden 
1978;  less  than  high  school  is  omitt 
variable 

WORKEXPECT 

work  expectations  in  5  years 

NOWORK 

periods  of  no  work  in  1978 

LIVEWITH1 

LIVEWITH2 

LIVEWITH3 

who  individual  lived  with  at  age  14 

FATHERGRAD1 

FATHERGRAD  2 

highest  grade  completed  by  responden 
father;  less  than  high  school  is 
omitted  variable 

MOTHERWORK1 

MOTHERWORK2 

number  of  hours  respondent's  mother 
workedin  1978;  zero  hours  omitted 

FEMALEWK14 

adult  female  in  household  worked  for 
pay  when  respondent  was  14 

TABLE  7  (continued) 


FAMILYATT 

REMEDIAL 

MOSWELFARE 

GOVTPRE78 

PRIVPRE78 


respondents  attitude  toward  the 
statement  "a  woman's  place  is  in  the 
home" 

whether  respondent  took  remedial  math 
or  English  or  English  as  a  second 
language 

months  on  welfare 

participated  in  a  government-sponsored 
employment  and  training  program  before 
1978 

participated  in  a  private  employment 
and  training  program  before  1978 


It  should  be  noted  that  analyses  using  these  data  sets  examined 
treatment  of  and  outcomes  for  individuals  who  were  enrolled  in 
government-sponsored  employment  and  training  programs  in  the  late 
1970s.  There  are  two  reasons  for  this.  First,  there  is  generally  a 
lag  between  the  time  data  are  collected  and  the  time  data  sets  are  made 
available  for  use.  This  lag  may  be  up  to  two  years  in  some  cases. 
Second,  if  one  wants  to  examine  postprogram  outcomes,  additional  time 
must  elapse  so  the  enrollee  can  leave  the  program  and  follow-up  data 
can  be  collected  on  the  status  of  the  participant  at  various  points 
after  leaving  the  program.  Consequently,  postprogram  data  on  employ¬ 
ment,  earnings,  and  other  outcomes  for  a  person  leaving  a  training 
program  in  1978  might  be  collected  in  1979  and  1980  and  be  available 
for  analysis  in  1981.  These  lags  make  it  difficult  to  measure  the 
effectiveness  of  current  programs  if  they  are  different  from  those 
offered  in  the  recent  past.  However,  evaluation  of  past  programs  can 
be  helpful  in  identifying  patterns  of  treatment  and  in  determining 
whether  some  types  of  programs  are  more  effective  than  others. 


Program  Treatment 

Three  aspects  of  program  treatment  are  of  interest:  program 
assignment,  services  received,  and  type  of  training  received.  The  type 
of  activity  an  individual  is  assigned  to  and  the  training  received  can 
affect  postprogram  outcomes.  Support  services,  such  as  medical  care, 
transportation,  and  child  care,  can  affect  the  ability  of  an  individual 
to  enter  or  continue  a  program. 


Program  Assignment 


Employment  and  training  programs  consist  of  four  basic  acti’ 
classroom  training;  on-the-job  training  (OJT) ;  public  service  ei 
(PSE) ,  which  was  discontinued  in  1981;  and  work-experience  prog. 
There  are  differences  in  the  assignment  of  men  and  women  to  the: 
activities.  Although  the  differences  are  greater  among  adults, 
exist  among  youths.  Young  women  are  more  likely  than  young  men 
assigned  to  work -experience  and  classroom-training  activities  a 
less  likely  to  be  assigned  to  OJT  and  (prior  to  1981)  PSE  (Tabl* 
These  differences  are  more  apparent  among  youths  over  age  18,  s 
those  under  age  18  are  most  likely  to  be  in  work-experience  pro< 
regardless  of  gender.  Sex  differences  are  slightly  greater  amo 
whites  than  among  blacks  or  Hispanics  because  minorities  of  bo- 
tend  to  be  more  likely  to  be  placed  in  work-experience  programs 
classroom  training  after  the  age  of  18. 

Differences  in  program  assignment  do  not  necessarily  repres 
discriminatory  treatment.  They  may  be  based  on  differences  in 
of  treatment  deemed  appropriate,  given  the  individual's  backgro 
they  may  be  the  result  of  differences  in  preferences  between  mei 
women.  In  their  analysis  of  the  type  of  skills  training  receiv 
researchers  at  Ohio  State  University  noted  that  young  women  in 
sample  were  more  likely  to  receive  classroom  training — be  it  co 
preparatory,  skills  training,  or  basic  education — and  men  were  i 
likely  to  receive  on-the-job  training  (Borus,  1983:126).  They 
that  these  differences  could  stem  from  preferences  on  the  part  < 
people;  young  women  do  better  in  school  and  are  therefore  more 
to  accept  such  an  assignment.  However,  this  would  certainly  be 
with  a  strategy  of  assigning  enrollees  on  the  basis  of  need,  si 
enrollees  tend  to  have  more  educational  deficiencies  than  femal' 
enrollees.  An  alternate  explanation  may  be  found  in  the  fact  t 
type  of  jobs  traditionally  held  by  women  are  more  likely  to  reqi 
skills  that  are  learned  in  the  classroom  and  those  held  by  youn 
are  more  likely  to  be  learned  on  the  job. 

A  Rand  Corporation  study  of  sexual  equity  in  CETA  (based  on 
CLMS)  used  a  different  approach  to  evaluating  the  gender  diffe: 
in  program  assignment  (Berryman  et  al.,  1981).  This  study  comp 
proportion  of  males  who  received  the  CETA  services  they  request* 
the  proportion  of  females  who  received  the  services  they  reques 
Although  the  differences  between  young  men  and  young  women  were 
than  the  differences  between  adult  men  and  adult  women,  some  p 
were  found.  In  the  categories  of  job  training  and  jobs,  men  wh* 
requested  OJT  and  PSE  were  more  likely  to  get  those  assignments 
women  who  requested  them.  On  the  other  hand,  young  women  who  r< 
classroom  training  in  basic  skills  were  more  likely  to  get  it  t 
young  men  who  requested  it  (Table  9) . 


1977  (in  percentages) 
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TABLE  9  Youth  Distribution  of  Obtained  CETA  Services  within 
Desired  Service  (in  percentages) 


In-Program 

Basic 

Skills 

Job  Training 

Job 

Assignment 

Sex 

FY76 

FY77 

FY78 

FY7  6a 

FY77 

FY78 

FY7  6a 

FY77 

FY7  8‘ 

Classroom 

Male 

37.3 

55.8 

71.0 

35.3 

42.7 

43.1 

9.1 

8.0 

8.0 

training 
(CT)  b 

Female 

81.4 

74.1 

71.8 

34.8 

54.6 

52.5 

8.6 

10.5 

11.6 

On-the-job 

Male 

4.4 

2.3 

3.4 

8.6 

9.7 

12.1 

7.2 

10.6 

8.1 

training 
(OJT ) c 

Female 

3.5 

1.5 

2.7 

3.7 

4.2 

5.7 

4.5 

6.3 

6.2 

Youth  work 

Male 

56.8 

41.4 

22.3 

50.3 

39.2 

35.1 

63.4 

52.5 

56.8 

exper ience 
(YWE)d 

Female 

15.1 

22.6 

23.4 

51.9 

36.2 

36.6 

74.4 

63.2 

63.6 

Public  service 

Male 

1.5 

0.5 

3.3 

5.8 

8.4 

9.7 

20.3 

28.9 

27.1 

employmen  t 
(PSE) e 

Female 

0.0 

1.8 

2.1 

9.5 

5.0 

5.2 

12.4 

20.0 

18.7 

NOTE:  Includes  only  participants  who  expressed  their  desired  CETA  services. 

aTotals  do  not  add  to  100.0  due  to  rounding. 

^Includes  CT  and  YETP  CT  in  fiscal  1978. 
c Includes  OJT  and  YETP  OJT  in  fiscal  1978. 
d Includes  YWE,  YETP  Other,  and  YCCIP  in  fiscal  1978. 

eIncludes  PSE  sustainment,  PSE  nonsustainment,  and  PSE  unknown  in  fiscal  1978. 
SOURCE:  S.E.  Berryman,  W.K.  Chow,  and  R.M.  Bell  (1981:67). 


Occupational  Segregation 

Both  the  Rand  study  and  the  Ohio  State  analysis  found  considerabli 
segregation  in  occupational  training  under  CETA  and  other  government 
programs.  Among  youths  enrolled  in  employment  and  training  programs 
1978,  Crowley  et  al.  (Borus,  1983:20,  162-163)  found  that  80  to  85 
percent  of  all  enrollees  in  professional,  clerical,  and  sales  trainin' 
programs  were  women,  while  78  percent  of  the  enrollees  in  skilled  labc 
and  craft  training  were  men.  The  low  percentage  of  women  in  the  lath 
programs  is  not  unexpected  given  that  only  25  percent  of  women  in  the 
1979  NLS  survey  aspired  to  atypical  jobs.  And  among  those  young  wome: 
who  were  interested  in  nontraditional  jobs,  most  were  interested  in 
managerial  and  professional  careers;  few  indicated  an  interest  in 
blue-collar  jobs.  Young  women  from  more  disadvantaged  families,  who 
are  the  target  group  for  government  programs,  are  less  likely  to  aspi 
to  nontraditional  occupations  and,  without  encouragement,  may  be 
unlikely  to  pick  employment  or  training  slots  in  traditionally  male 
fields . 

Berryman  et  al.  (1981:44-45)  also  found  CETA  enrollees  to  be  very 
traditional  in  their  job  preferences,  although  that  seemed  to  decrease 


somewhat  with  time.  In  1976,  82  percent  of  the  young  women  wanted 
traditionally  female  jobs  and  only  4  percent  wanted  traditionally  male 
jobs.  The  remaining  14  percent  wanted  jobs  that  were  categorized  as 
mixed  (neither  predominately  male  nor  predominately  female).  By  1978, 
the  proportion  wanting  traditionally  female  jobs  dropped  to  60  percent, 
those  desiring  traditionally  male  jobs  rose  to  15  percent,  and  those 
seeking  mixed  jobs  rose  to  24  percent.  Over  the  same  period,  CETA 
began  to  place  more  young  women  in  traditionally  male  jobs  and  fewer  in 
traditionally  female  jobs,  and  the  shifts  were  greatest  for  minority 
females . 


Supportive  Services 

The  service  received  most  often  by  youths  is  job  counseling.  About 
one-half  of  both  men  and  women  received  counseling.  Medical  services, 
transportation,  and  child-care  services  were  not  received  by  large 
proportions  of  the  youth  population,  but  the  need  for  such  services 
among  the  youth  population  is  not  known.  Female  heads  of  household 
were  more  likely  to  receive  health  and  child-care  services  than  others, 
but  less  than  one-half  of  that  group  received  any  services  in  1978 
(Borus,  1983;  Simms  and  Leitch,  1983). 


Program  Outcomes 

The  expected  outcomes  of  program  participation  have  been  and 
continue  to  be  diverse.  In  addition  to  increased  postprogram  earnings 
(the  primary  goal  for  adults) ,  other  objectives  include  increased 
educational  attainment  (lower  school  dropout  rates) ,  a  reduction  in 
early  childbearing,  reduced  welfare  dependency,  and  reduced  criminal 
activity.  Success  in  achieving  these  multiple  goals,  however,  is  often 
difficult  to  measure. 

To  assess  the  net  impact  of  program  participation,  information  is 
needed  on  the  outcomes  and  variables,  other  than  program  participation, 
that  are  likely  to  affect  outcomes  for  both  the  preprogram  and  post¬ 
program  periods.  Moreover,  comparable  information  is  needed  for  a 
group  of  individuals  who  have  similar  preprogram  characteristics  but 
who  were  not  enrolled  in  the  program.  Such  comprehensive  information 
is  seldom  available.  Therefore,  the  outcomes  examined  most  often  are 
postprogram  earnings  and  employment  because  more  data  are  available  on 
those  outcomes,  both  for  program  participants  and  for  individuals  who 
may  be  part  of  a  comparison  group. 


Earnings  and  Employment  Gains 

One  fairly  consistent  conclusion,  at  least  in  evaluations  of 
outcomes  for  adults,  is  that  women  and  the  economically  disadvantaged 
receive  the  greatest  gains  from  participation  in  employment  and  training 
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programs.2  This  was  true  for  the  early  programs  established  under 
MDTA  and  has  continued  to  be  true  under  CETA  (Perry  et  al.,  1975; 
Bassi,  1982;  Congressional  Budget  Office  and  National  Commission  for 
Employment  Policy,  1982).  There  is  no  consistency,  however,  in  the 
assessment  of  which  program  activities  have  the  greatest  effect  or  the 
mechanism  by  which  those  gains  are  made.  For  example,  some  studies 
conclude  that  OJT  and  skills  training  have  the  highest  payoffs  (Harlan 
1980) ,  but  other  studies  point  out  that  the  employment  gains  of  those 
two  programs  decay  over  time  (U.S.  Department  of  Labor,  1977).  A 
recent  study  using  the  Continuous  Longitudinal  Manpower  Survey, 
however,  found  that  the  net  earnings  gains  for  women  do  not  vary  by 
program  activity  but  are  in  the  range  of  $800  to  $1,300  for  all 
programs .  Moreover ,  the  gains  do  not  appear  to  decrease  over  time 
(Congressional  Budget  Office  and  National  Commission  for  Employment 
Policy,  1982) . 

Findings  from  a  recently  completed  study  by  The  Urban  Institute 
(Bassi  et  al.,  1984),  which  used  the  1977  CLMS,  indicate  that  many  of 
the  programs  that  work  for  adults  also  work  for  youths.  Participation 
in  PSE  programs  increased  earnings  for  white  women  by  $882  to  $990  in 
the  first  postprogram  year  and  by  $1,035  to  $1,144  in  the  second 
postprogram  year.3  For  black  women  in  PSE  the  gains  were  $1,126  to 
$1,196  in  the  first  year  and  $608  to  $678  in  the  second  postprogram 
year,  and  for  Hispanic  women  in  PSE  the  significant  gain  was  $1,705  to 
$1,862  in  the  first  postprogram  year.  Black  women  also  benefited  from 
participation  in  OJT;  they  showed  gains  of  $861  to  $877  in  the  first 
year  and  of  $1,389  to  $1,406  in  the  second  year  after  leaving  the 
program.  The  only  significant  gain  for  men  was  for  white  men  in  OJT, 
who  experienced  an  increase  in  earnings  of  $452  to  $463  in  the  first 
postprogram  year.  Most  of  the  gains  for  women  were  the  result  of 
increases  in  time  in  the  labor  force,  time  employed,  and  hours  worked; 
only  3  to  10  percent  of  the  gains  were  attributable  to  increased 
average  hourly  wages.  A  larger  proportion  of  the  gains  for  white  men 
(16  percent)  was  attributable  to  increases  in  hourly  wages  and  less  to 
additional  time  employed.  Even  though  women  benefited  more  from  CETA 
participation  in  terms  of  gains  in  earnings,  mean  postprogram  Social 
Security  earnings  for  young  women  were  lower  than  those  for  young  men. 

Youths  in  other  programs  either  showed  no  gain  or  a  loss  in 
earnings  compared  with  a  matched  sample  drawn  from  the  CPS.  However, 
even  individuals  in  those  programs  increased  their  labor  force  activit 
between  preprogram  and  postprogram  years  and  showed  gains  in  reported 


2Note  that  some  of  the  studies  cited  measured  gross  earnings  and/or 
employment  impact,  and  others  measured  net  earnings  and/or  employment 
gains  (using  a  control  group) .  This  changes  the  magnitude  but  not  the 
sign  of  the  results  for  women. 

3However,  these  findings  are  not  definitive  since  the  Chow  tests 
indicated  a  significant  difference  between  young  white  women  who 
participated  in  CETA  and  their  comparison  group. 
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hourly  wages.  It  would  appear  that  the  participants'  failure  to  make 
gains  relative  to  the  comparison  group  is  due  to  the  fact  that  the 
increases  in  labor  force  activity  of  CETA  participants  are  not  as  large 
as  the  gains  made  by  nonparticipants.  This  may  or  may  not  be  the 
result  of  non-labor-market  activity,  such  as  time  spent  in  school.  It 
is  impossible  to  confirm  these  assumptions,  since  no  postprogram  infor¬ 
mation  on  the  labor  force  activity  or  school  status  of  members  of  the 
comparison  group  was  available. 

Using  the  1976  CLMS  to  measure  the  effect  of  program  activity  on 
employment  immediately  after  leaving  the  program,  Harlan  and  Hackett 
(1984)  found  that  programs  that  enrolled  more  men  than  women  (such  as 
OJT)  provided  the  greatest  possibility  for  immediate  postprogram 
employment  and  that  those  with  the  largest  proportion  of  women  had  the 
lowest  possibilities.  If  population  groups  were  shifted  among  programs 
so  that  minorities  and  women  were  distributed  like  white  men,  post¬ 
program  employment  for  those  groups  would  increase,  although  it  would 
still  lag  that  for  white  men.  (No  separate  analysis  was  done  for 
youths . ) 

Hahn  and  Lerman  (1983)  used  the  NLS  to  analyze  the  effect  of  CETA 
programs  on  school  enrollment  and  unsubsidized  job  experience.  They 
found  that  while  CETA  did  seem  to  increase  school  enrollment  among 
women  and  nonwhite  men,  it  had  very  little  positive  effect  on  unsub¬ 
sidized  employment.  Youths  who  had  not  been  enrolled  in  CETA  had 
higher  rates  of  unsubsidized  employment  and  had  higher  earnings  from 
unsubsidized  employment.  This  was  especially  true  for  women,  although 
young  female  CETA  participants  who  mixed  school  and  work  had  higher 
unsubsidized  earnings  per  week  in  the  first  year.  By  1980  young  female 
CETA  participants  who  were  both  in  school  and  working  were  more  likely 
to  have  unsubsidized  jobs  than  their  non-CETA  counterparts. 


Other  Outcome  Measures 

Very  little  information  on  outcome  measures  other  than  employment 
and  earnings  is  available  on  CETA  activities  as  a  group.  Bassi  et  al . 
(1984)  did  examine  the  effect  of  CETA  on  welfare  dependency  for  CETA 
enrollees  in  1977  who  were  between  the  ages  of  18  and  65.  The  results 
of  the  analysis  show  that  CETA  does  decrease  the  level  of  welfare 
dependency,  but  it  does  not  lead  to  removal  from  the  welfare  rolls  (at 
least  not  under  the  regulations  in  force  in  1978  and  1979)  .  In  1978 
the  estimated  annual  welfare  savings  for  women  who  headed  households 
was  $250.  This  finding  is  consistent  with  the  fact  that  women  received 
the  highest  gains  in  earnings  from  CETA  participation.  No  significant 
welfare  savings  were  found  for  men.  This  is  consistent  with  the  finding 
that  there  was  not,  in  general,  a  substantial  gain  in  earnings  for  men. 

A  recently  completed  analysis  of  the  long-term  effects  on  youths  of 
government-subsidized  employment  and  training  programs  used  the  NLS  to 
examine  the  impact  of  participation  in  five  program  activities  (sub¬ 
sidized  employment,  classroom  skills  training,  basic  education,  job 
counseling,  and  other)  on  employment,  earnings,  educational  attainment, 
and  welfare  dependency  (Crowley,  1984)  .  The  effect  of  participation  in 
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1978,  1979,  or  1980  on  1981  status  or  outcomes  was  found  to  be  insig¬ 
nificant  for  earnings  and  hourly  wages  for  both  men  and  women,  althougl 
it  seemed  to  lead  to  subsidized  employment  at  a  later  date.  Participa¬ 
tion  in  a  basic  educational  program  was  positively  related  to  obtaining 
a  General  Equivalency  Diploma  (GED)  for  both  men  and  women  and  to  schoc 
enrollment  for  women.  Participation  in  a  skills  training  program  had  < 
negative  effect  on  subsequent  school  enrollment  for  young  women.  Younc 
women  who  received  job  counseling  (in  1979)  or  participated  in  sub¬ 
sidized  employment  programs  (in  1980)  actually  were  more  likely  to  be 
on  welfare  and  to  receive  larger  amounts  of  welfare  than  nonpartici¬ 
pants.  This  could  be  related  to  greater  knowledge  of  the  benefit 
programs  to  which  they  might  be  entitled.  Women  who  were  in  programs 
in  1978  had  lower  levels  of  dependency  on  welfare  in  1981,  which 
indicates  a  possible  lag  between  program  participation  and  movement  of: 
welfare  among  younger  women. 

There  have  been  some  evaluations  of  the  effect  of  individual 
employment  and  training  programs  on  a  variety  of  outcome  measures.  On< 
such  study  is  the  evaluation  of  the  Job  Corps  conducted  by  Mathematica 
Policy  Research  Corporation  (Mallar  et  al.,  1980).  This  study  found 
that  in  addition  to  increasing  employment  and  earnings.  Job  Corps  also 
increased  the  probability  of  high  school  completion  and  college 
enrollment  and  decreased  criminal  behavior  and  welfare  dependency.  Foi 
young  women,  participation  in  Job  Corps  also  appeared  to  delay  family 
formation  and  to  reduce  the  incidence  of  extramarital  childbearing. 

The  impact  on  employment,  earnings,  education,  and  welfare  payments  wa: 
greater  for  women  without  children  than  for  those  with  children.  This 
may  be  due  to  the  fact  that  the  burden  of  family  responsibilities  on 
those  with  children  limited  their  labor  force  participation  after 
leaving  the  program. 

Another  program  for  which  a  variety  of  outcome  measures  has  been 
evaluated  is  the  Youth  Incentive  Entitlement  Pilot  Projects  (YIEPP)  . 
This  program,  initiated  under  YEDPA,  guaranteed  jobs  to  eligible  16-  t< 
19-year-olds  (part-time  jobs  during  the  school  year  and  full-time  jobs 
during  the  summer)  if  they  stayed  in  or  returned  to  school  and  met 
specified  attendance  and  performance  standards.  A  comparison  of  men 
and  women  eligible  to  participate  found  that  the  participation  rates 
for  young  men  and  young  women  were  quite  similar  and  so  were  the 
average  number  of  months  in  the  program  (Farkas  et  al.,  1984).  There 
were  substantive  gains  in  earnings  for  both  men  and  women  during 
program  participation,  mainly  due  to  increased  employment.  However, 
the  difference  in  earning  gains  between  young  women  and  young  men  in 
the  postprogram  period  was  significant — gains  in  weekly  earnings  for 
men  ($13.66)  were  twice  those  for  women.  Since  nearly  one-half  of  the 
young  women  in  YIEPP  had  had  at  least  one  child  by  the  time  they 
reached  the  age  of  19,  it  was  thought  that  home  responsibilities  may 
have  had  a  negative  effect  on  labor  force  participation  among  women. 
However,  the  rate  of  childbearing,  while  quite  high,  varied  sub¬ 
stantially  from  site  to  site  within  YIEPP,  and  on  average  the  45 
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of  young,  low-income  women  and  that  the  high  rate  of  childbearing 
probably  explained  at  least  part  of  the  difference  in  earnings  gains 
between  male  and  female  participants  in  YIEPP.  The  latter  conclusion 
seems  to  be  consistent  with  the  fact  that  the  gap  between  the  weekly 
earnings  of  men  and  women  in  the  program  increases  as  they  grow  older. 
Even  though  the  gains  to  young  women  are  smaller  than  those  to  young 
men,  however,  female  program  participants  still  do  better  than  women  in 
the  comparison  group. 

While  YIEPP  did  increase  labor  force  participation  and  lower 
unemployment,  it  did  not  seem  to  increase  school  enrollment.  This  may 
have  been  due,  in  part,  to  the  failure  to  attract  or  retain  high  school 
dropouts.  However,  the  program  did  not  appear  to  increase  dropout 
rates  either  (which  had  been  true  of  some  other  programs) ,  since  there 
was  a  school  enrollment  requirement. 

A  program  that  puts  less  emphasis  on  job  training,  per  se,  and  more 
emphasis  on  a  system  of  supportive  services  is  Project  Redirection, 
jointly  sponsored  by  the  Ford  Foundation  and  the  U.  S.  Department  of 
Labor.  This  program  sponsors  or  brokers  services  for  pregnant  teen¬ 
agers  and  teenage  mothers  (under  age  18)  who  are  without  high  school 
diplomas  and  who  are  in  welfare  families.  The  final  report  on  the 
impact  of  Project  Redirection  has  not  been  released  yet  but  findings 
from  the  12-month  follow-up  study  indicate  positive  results  from 
program  participation  in  terms  of  employment  and  education,  with  slight 
decreases  in  the  incidence  of  pregnancy  (Polit  et  al.,  1983).  Since  12 
months  is  a  short  follow-up  period  for  evaluating  program  outcomes, 
especially  since  many  individuals  were  still  enrolled  in  the  program, 
the  findings  must  be  regarded  as  tentative.  What  may  be  of  greater 
interest  is  that  the  program  provides  an  effective  set  of  support 
services,  such  as  child  care  and  housing  assistance,  that  frequently 
are  not  available  in  other  programs  and  are  obviously  felt  to  be  needed 
by  teenage  mothers. 


SUMMARY  AND  CONCLUSIONS 

Government  employment  and  training  programs  have  been  utilized  by 
both  young  men  and  young  women  over  the  past  20  years.  While  differ¬ 
ences  in  participation  based  on  sex  were  quite  clear  during  the  early 
years,  they  are  less  clear  now.  A  review  of  young  women's  participa¬ 
tion  in  government-sponsored  employment  and  training  programs  reveals 
that  the  level  of  participation  has  increased  in  recent  years  to  a 
level  approaching  parity  in  most  programs,  although  a  few  programs, 
like  Job  Corps,  still  lag  the  others.  Although  young  women  who  enroll 
in  government  programs  have  somewhat  higher  educational  levels  than 
young  men,  this  appears  not  to  be  a  significant  factor  in  program 
enrollment.  The  factors  that  affect  young  women's  enrollment  appear  to 
be  quite  similar  to  those  that  affect  young  men.  However,  there  still 
appear  to  be  differences  in  the  treatment  received  by  young  women  and 
young  men.  Women  are  more  likely  to  be  involved  in  classroom  training 
or  work -experience  programs  that  are  less  likely  to  integrate  them  into 
the  job  market,  and  they  continue  to  be  trained  in  traditionally  female 
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occupations.  Few  young  women  receive  supportive  services  other  than 
counseling,  and  even  women  with  children  receive  low  levels  of  suppor 
in  terms  of  child  care. 

Young  women,  like  their  adult  counterparts,  benefit  more  from 
participation  in  employment  and  training  programs  than  do  young  men. 
They  receive  higher  employment  and  earnings  gains  from  the  activities 
in  which  they  are  least  likely  to  be  assigned,  such  as  on-the-job 
training  and  public  service  employment.  Most  of  these  gains  come  fro: 
increased  time  employed,  however,  and  not  from  higher  wage  rates. 
Evaluations  of  selected  programs,  like  Job  Corps,  also  reveal  gains  i 
such  areas  as  educational  attainment,  reduced  welfare  dependency  and 
criminality,  and  delayed  family  formation.  Women  with  children  seem 
benefit  less  from  the  programs  than  those  without  children,  perhaps 
because  family  responsibilities  prevent  them  from  increasing  their 
postprogram  labor  force  participation. 

This  review  of  studies  of  young  women's  participation  in  employme 
and  training  programs  has  identified  several  shortcomings  in  both  our 
knowledge  and  in  the  operation  of  employment  and  training  programs. 
These  shortcomings  prompt  the  following  research  recommendations: 

1.  Relatively  little  is  known  about  the  effects  of  employment  an 
training  programs  on  nonemployment  outcomes,  such  as  educational  atta 
ment,  welfare  dependency,  and  childbearing  patterns.  For  youths, 
especially  young  women,  these  outcomes  may  have  greater  long-term 
economic  consequences  than  the  impact  programs  may  have  on  short-term 
employment  and  earnings.  Therefore,  more  research  should  be  done  on 
nonemployment  outcomes  and  their  link  to  long-term  employment  and 
earnings  gains.  While  the  1979  NLS  has  advantages  as  a  data  set  beca 
it  includes  nonparticipants  in  the  sample,  precise  information  on  the 
programs  in  which  the  enrollees  participated  is  scanty.  Program-base 
data  sets,  such  as  the  CLMS  or  the  new  JTLS,  will  provide  better 
information  on  programs  and  services  received.  However,  the  CLMS 
comparison  group  (drawn  from  the  Current  Population  Survey)  lacks 
longitudinal  information  on  outcomes  other  than  participants'  earning 
It  is  to  be  hoped  that  the  Job  Training  Longitudinal  Survey  (JTLS)  da 
base,  to  be  developed  under  JTPA,  will  not  have  the  same  shortcomings 
In  the  interim  period  before  the  JTLS  is  available,  it  would  be 
possible  to  conduct  research  on  nonemployment  outcomes  by  drawing  a 
comparison  group  from  the  NLS  for  use  with  the  late  CLMS  cohorts  (197 
and  later) ,  since  information  is  available  for  roughly  comparable 
periods . 

2.  Another  area  in  which  we  lack  knowledge  concerns  the  low  leve 
of  support  services  provided  to  youths.  For  example,  is  child  care  n 
provided  because  it  is  not  requested  or  because  it  is  not  available? 
To  what  extent  does  nonavailability  of  child-care  services  or 
transportation  reduce  program  participation,  especially  among  young 
women?  [An  on-going  Urban  Institute  study  (Sonenstein  and  Wolf,  1985 
will  provide  insight  into  the  relationship  between  the  availability  o 
child  care  and  employment  or  participation  in  education  or  training 
programs .] 
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In  terms  of  program  operation,  there  are  also  suggestions  for 
change . 


1.  The  fact  that  young  women  are  assigned  to  different  programs 
than  young  men  (and  disproportionately  to  those  with  lower  expected 
earnings  gains)  suggests  that  program  operators  need  to  be  more 
sensitive  to  possible  gender  differences  in  program  assignment  and  that 
more  emphasis  on  preprogram  counseling  might  be  needed. 

2.  Related  to  the  above,  while  today's  young  women  are  more  likely 
to  expect  to  be  working  during  their  adult  lives  than  earlier  genera¬ 
tions  of  young  women,  they  are  not  as  open  to  nontraditional  careers  as 
they  need  to  be  if  they  are  to  increase  their  earning  power  signifi¬ 
cantly.  Employment  and  training  programs  (particularly  job  counseling 
programs)  should  include  information  about  job  opportunities  in  non¬ 
traditional  careers  and  the  skills  and  education  needed  to  enter  those 
careers.  Support  and  encouragement  may  also  be  needed  to  get  more 
young  women  into  the  training  "pipeline"  for  those  occupations. 

3.  Low-income  young  women  have  relatively  high  birth  rates  during 
their  teenage  years.  While  little  is  known  about  the  effect  of 
participation  in  employment  and  training  programs  on  subsequent 
childbearing,  we  do  know  that  young  women  with  children  are  less  likely 
to  participate  in  programs  and  may  receive  lower  benefits  from 
participation.  More  emphasis  needs  to  be  placed  on  outreach  and  on 
facilitating  the  participation  of  young  mothers  in  programs. 

Moreover,  support  services  (like  child  care)  need  to  be  available  to 
these  women  after  they  leave  programs  in  order  to  increase  their 
postprogram  labor  force  participation. 
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